-- Logs begin at Mon 2021-11-08 15:33:01 UTC, end at Mon 2021-11-08 16:32:59 UTC. -- Nov 08 16:02:51.249644 dv-cinder-816187-2-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Nov 08 16:02:53.961976 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.common.config [-] Logging enabled! Nov 08 16:02:53.962595 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev147 Nov 08 16:02:53.962758 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=101137) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 08 16:02:53.965918 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.common.config [-] Logging enabled! Nov 08 16:02:53.966176 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev147 Nov 08 16:02:53.966486 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=101137) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 08 16:02:53.967410 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 08 16:02:53.967644 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 08 16:02:53.968002 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 08 16:02:53.968246 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 08 16:02:53.968471 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 08 16:02:53.968789 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.969210 dv-cinder-816187-2-iscsi neutron-server[101137]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Nov 08 16:02:53.969519 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.969848 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.970141 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.970432 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.970723 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.971004 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.971289 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.971585 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.971867 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.972145 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.972424 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.972712 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.972990 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] config_source = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.973273 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.973557 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.973860 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] debug = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.974141 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.974566 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.974966 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.975245 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.975563 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.975840 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.976109 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.976383 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.976666 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.977000 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] host = dv-cinder-816187-2-iscsi {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.977275 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.977559 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.977868 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.978155 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.978428 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.978701 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.978984 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.979254 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] log_dir = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.979523 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] log_file = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.979795 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.980078 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.980360 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.980645 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.980868 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.981086 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.981381 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.981664 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.981963 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.982234 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.982504 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.982775 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.983046 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.983312 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.983595 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.983877 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.984156 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.984428 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.984699 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.984968 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.985237 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.985519 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.985819 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.986091 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.986360 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.986641 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.986913 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.987183 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.987480 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.987761 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.988042 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.988323 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.988594 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.988873 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.989142 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.989413 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] use_journal = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.989679 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] use_json = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.989977 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.990244 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.990520 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.990790 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.991586 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.991858 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.992128 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.992408 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:53.992699 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:53.992994 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:53.993290 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:53.993568 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:53.993896 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:53.994174 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:53.994460 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:53.994732 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:53.995015 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:53.995300 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:53.995584 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:53.996106 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:53.996401 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:53.996671 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:53.996962 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:53.997260 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:53.997553 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:53.997879 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:53.998156 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:53.998429 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:53.998697 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:53.998971 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:53.999254 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:53.999529 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:53.999815 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.000099 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.000374 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.000658 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.000949 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.001237 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.001512 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.001817 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.002107 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.002381 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.002652 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.002924 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.003208 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.003481 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.003753 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.004031 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.004306 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.004576 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.004843 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.005114 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.005399 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.005672 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.005963 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.006229 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.006501 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.007337 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.007615 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.007890 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.008159 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.008428 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.008702 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.008970 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.009240 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.009509 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.009802 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.010078 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.010346 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.010614 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.010882 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.011147 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.011413 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.011678 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.011944 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.012215 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.012481 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.012748 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.013017 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.013286 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.013553 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.013878 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.014178 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.014453 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.014728 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.015003 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.015277 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.015550 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.015824 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.016102 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.016375 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.016644 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.016931 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.017214 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.017497 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.017801 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.018080 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.018396 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.018671 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.018952 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.019226 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.019499 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.019779 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.020059 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.020351 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.020640 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.020929 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.021218 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.021507 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.021818 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.022129 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.022430 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:54.022645 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 08 16:02:54.022883 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=101137) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Nov 08 16:02:54.451880 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=101137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:02:54.452160 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=101137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:02:54.452463 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=101137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 16:02:54.452800 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.manager [-] Loading core plugin: ml2 Nov 08 16:02:54.771598 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:54.771908 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:54.772716 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:54.773957 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:54.774239 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:54.774500 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:54.808252 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:54.808529 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:54.808799 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:54.824390 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:54.824670 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:54.824942 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:54.854639 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:54.854928 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:54.855197 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:54.891476 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:54.891752 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:54.892017 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.127216 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.127723 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.127808 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.128010 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.128720 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.256092 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.256408 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.256740 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.257011 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.257278 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.257588 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.257868 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.258124 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.258381 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.258664 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.258924 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.259186 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.259439 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.259687 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.259938 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.260198 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.260451 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.260722 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.260979 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.261232 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.261501 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.261775 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.262055 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.262428 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.262674 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.262917 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.263307 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=101137) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 08 16:02:55.263545 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=101137) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 08 16:02:55.263780 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=101137) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 08 16:02:55.264018 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=101137) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 08 16:02:55.264255 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=101137) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 08 16:02:55.264485 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=101137) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 08 16:02:55.264842 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Nov 08 16:02:55.268123 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Nov 08 16:02:55.272610 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Nov 08 16:02:55.276411 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(150, 199)])]) Nov 08 16:02:55.278079 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Nov 08 16:02:55.278536 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Nov 08 16:02:55.278873 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Nov 08 16:02:55.279255 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Nov 08 16:02:55.282095 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Nov 08 16:02:55.282350 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Nov 08 16:02:55.282701 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Nov 08 16:02:55.288536 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Nov 08 16:02:55.310683 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Nov 08 16:02:55.311129 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.311423 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=101137) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}} Nov 08 16:02:55.311783 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.313170 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=101137) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Nov 08 16:02:55.313453 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Nov 08 16:02:55.313699 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Nov 08 16:02:55.316890 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.317168 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:55.380643 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Nov 08 16:02:55.380824 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Nov 08 16:02:55.381061 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Nov 08 16:02:55.381426 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Nov 08 16:02:55.402009 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_db.sqlalchemy.engines [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101137) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 16:02:55.933567 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.managers [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Initializing driver for type 'gre' Nov 08 16:02:55.934109 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] gre ID ranges: [(1, 1000)] Nov 08 16:02:55.982271 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.managers [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Initializing driver for type 'local' Nov 08 16:02:55.982603 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.managers [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Initializing driver for type 'vlan' Nov 08 16:02:55.994952 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] VlanTypeDriver initialization complete Nov 08 16:02:55.995279 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.managers [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Initializing driver for type 'vxlan' Nov 08 16:02:55.995739 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] vxlan ID ranges: [(1, 1000)] Nov 08 16:02:56.047029 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.managers [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Initializing extension driver 'port_security' Nov 08 16:02:56.047364 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.extensions.port_security [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] PortSecurityExtensionDriver initialization complete Nov 08 16:02:56.047690 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.managers [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Initializing mechanism driver 'openvswitch' Nov 08 16:02:56.048009 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.managers [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Initializing mechanism driver 'hyperv' Nov 08 16:02:56.055108 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.plugins.ml2.plugin [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=101137) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:02:56.055930 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > port after_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.056299 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > port after_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.056646 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > port after_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.057168 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=101137) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 08 16:02:56.057595 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > subnet after_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.057968 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > subnet after_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.058309 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > subnet after_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.058706 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=101137) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 08 16:02:56.059107 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > network after_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.059451 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > network after_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.059790 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > network after_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.060179 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=101137) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 08 16:02:56.060582 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > security_group after_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.060928 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > security_group after_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.061264 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > security_group after_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.061657 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=101137) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 08 16:02:56.062079 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.062423 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.062755 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.063145 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=101137) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 08 16:02:56.063547 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > address_group after_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.063893 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > address_group after_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.064229 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > address_group after_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.064618 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=101137) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 08 16:02:56.064989 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] ML2 OVO RPC backend initialized. {{(pid=101137) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Nov 08 16:02:56.065676 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router_interface after_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.066046 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.066454 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > network before_response 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.066791 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > networks before_response 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.067129 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > port before_response 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.067465 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > ports before_response 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.067799 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > subnet before_response 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.068132 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > subnets before_response 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.068466 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > network after_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.068797 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > network after_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.069685 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > network after_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.070064 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > port after_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.070393 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > port after_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.070721 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > port after_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.071048 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > subnet after_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.071374 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > subnet after_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.071701 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > subnet after_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.072261 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.plugin [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Modular L2 Plugin initialization complete Nov 08 16:02:56.072581 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading services supported by the core plugin {{(pid=101137) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Nov 08 16:02:56.072898 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.plugins.ml2.managers [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Got port-security extension from driver 'port_security' Nov 08 16:02:56.073350 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.extensions.vlantransparent [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Disabled vlantransparent extension. Nov 08 16:02:56.073859 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=101137) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Nov 08 16:02:56.074169 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading Plugin: router Nov 08 16:02:56.109379 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router_interface before_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.109790 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router after_create 55549900 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.110160 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router before_create 55549900 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.110514 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router_interface before_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.110878 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.111227 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router after_delete 55549900 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.111578 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > floatingip after_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.112047 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > floatingip after_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.112399 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router after_create 55549900 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.112741 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router after_update 55549900 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.113085 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router after_update 55549900 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.113423 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.113803 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router after_update 55549900 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.114208 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router precommit_update 55549900 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.114571 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: port after_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.114906 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: port after_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.115238 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: subnet after_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.115567 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.116441 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > port precommit_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.116785 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router precommit_create 55549900 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.117121 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: port before_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.117457 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router precommit_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.117839 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router after_update 55549900 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.118181 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router precommit_delete 55549900 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.118528 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router precommit_create 55549900 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.118882 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router_interface after_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.119218 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router precommit_update 55549900 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.119574 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > agent after_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.119919 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > agent after_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.120257 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > network after_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.121376 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Tracking information for resource: router configured {{(pid=101137) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 08 16:02:56.121700 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Tracking information for resource: floatingip configured {{(pid=101137) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 08 16:02:56.126604 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.db.l3_agentschedulers_db [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Nov 08 16:02:56.127175 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: port after_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.127531 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: port after_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.128051 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: port after_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.128212 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: port after_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.128991 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router before_create 55550100 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.129351 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router precommit_delete 55550100 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.129722 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router precommit_create 55550100 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.130076 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > router precommit_update 55550100 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.135427 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.services.provider_configuration [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Service providers = [] {{(pid=101137) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Nov 08 16:02:56.135787 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.db.servicetype_db [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=101137) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Nov 08 16:02:56.138743 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.services.service_base [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=101137) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 08 16:02:56.139088 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.services.service_base [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=101137) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 08 16:02:56.139425 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.services.service_base [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=101137) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 08 16:02:56.140309 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.services.service_base [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=101137) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 08 16:02:56.140672 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.services.service_base [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Default provider is not specified for service type L3_ROUTER_NAT Nov 08 16:02:56.141038 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=101137) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 08 16:02:56.141350 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Nov 08 16:02:56.153346 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=101137) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 08 16:02:56.153672 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading Plugin: auto_allocate Nov 08 16:02:56.159435 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: network precommit_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.159804 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: network precommit_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.160314 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=101137) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 08 16:02:56.160630 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading Plugin: tag Nov 08 16:02:56.167418 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=101137) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 08 16:02:56.167749 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading Plugin: timestamp Nov 08 16:02:56.171569 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=101137) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 08 16:02:56.171898 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading Plugin: network_ip_availability Nov 08 16:02:56.177347 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.177727 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.178082 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.179371 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=101137) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 08 16:02:56.179687 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading Plugin: flavors Nov 08 16:02:56.184681 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=101137) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 08 16:02:56.184959 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading Plugin: revisions Nov 08 16:02:56.189273 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=101137) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 08 16:02:56.189662 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_concurrency.lockutils [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.737s {{(pid=101137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 16:02:56.190411 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=101137) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Nov 08 16:02:56.190745 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Initializing extension manager. Nov 08 16:02:56.191263 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: __init__.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.191602 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: __pycache__ {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.191937 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.192265 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: address_group.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.193010 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.193571 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: address-group Nov 08 16:02:56.193922 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: address_scope.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.195188 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.195688 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: address-scope Nov 08 16:02:56.196007 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: admin_state_down_before_update.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.196929 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.197431 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: router-admin-state-down-before-update Nov 08 16:02:56.197772 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: agent.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.198470 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.198964 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: agent Nov 08 16:02:56.199282 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: agent_resources_synced.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.200184 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.200683 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: agent-resources-synced Nov 08 16:02:56.200996 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: allowedaddresspairs.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.202793 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.203306 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: allowed-address-pairs Nov 08 16:02:56.203629 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: auto_allocated_topology.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.204703 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.205210 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: auto-allocated-topology Nov 08 16:02:56.205534 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: availability_zone.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.206247 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.206745 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: availability_zone Nov 08 16:02:56.207061 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: availability_zone_filter.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.207966 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.208468 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: availability_zone_filter Nov 08 16:02:56.208783 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: data_plane_status.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.209746 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.210237 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension data-plane-status not supported by any of loaded plugins Nov 08 16:02:56.210557 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: default_subnetpools.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.211465 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.211963 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: default-subnetpools Nov 08 16:02:56.212279 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: dhcpagentscheduler.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.213075 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.213571 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: dhcp_agent_scheduler Nov 08 16:02:56.213916 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: dns.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.214829 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.215323 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension dns-integration not supported by any of loaded plugins Nov 08 16:02:56.215642 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: dns_domain_ports.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.216552 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.217049 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension dns-domain-ports not supported by any of loaded plugins Nov 08 16:02:56.217370 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.218314 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.218813 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Nov 08 16:02:56.219130 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: dvr.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.219794 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.220290 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: dvr Nov 08 16:02:56.220603 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: ecmp_routes.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.221518 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.222044 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension ecmp_routes not supported by any of loaded plugins Nov 08 16:02:56.222360 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: empty_string_filtering.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.223267 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.223766 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: empty-string-filtering Nov 08 16:02:56.224080 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.224977 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.225584 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Nov 08 16:02:56.225924 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.226836 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.227332 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Nov 08 16:02:56.227645 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: external_net.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.228548 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.229045 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: external-net Nov 08 16:02:56.229361 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: extra_dhcp_opt.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.230281 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.230778 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: extra_dhcp_opt Nov 08 16:02:56.231092 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: extraroute.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.232006 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.232496 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: extraroute Nov 08 16:02:56.232811 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: extraroute_atomic.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.233870 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.234371 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: extraroute-atomic Nov 08 16:02:56.234688 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: filter_validation.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.235517 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.236017 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: filter-validation Nov 08 16:02:56.236338 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: fip_pf_description.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.237246 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.237762 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Nov 08 16:02:56.238083 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: fip_port_details.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.238994 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.239490 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: fip-port-details Nov 08 16:02:56.239807 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: flavors.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.241548 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.242091 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: flavors Nov 08 16:02:56.242417 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.244092 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.244607 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Nov 08 16:02:56.244936 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: floatingip_pools.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.245632 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.246418 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: floatingip-pools Nov 08 16:02:56.246739 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: ip_allocation.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.247660 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.248158 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension ip_allocation not supported by any of loaded plugins Nov 08 16:02:56.248476 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.249394 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.249924 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: ip-substring-filtering Nov 08 16:02:56.250247 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: l2_adjacency.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.251164 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.251670 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension l2_adjacency not supported by any of loaded plugins Nov 08 16:02:56.251989 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: l3.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.252938 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.253442 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: router Nov 08 16:02:56.253786 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: l3_conntrack_helper.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.256008 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.257056 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension l3-conntrack-helper not supported by any of loaded plugins Nov 08 16:02:56.257389 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.258355 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.258862 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: ext-gw-mode Nov 08 16:02:56.259183 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.260138 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.260641 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: l3-ha Nov 08 16:02:56.260960 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: l3_flavors.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.261898 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.262402 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: l3-flavors Nov 08 16:02:56.262719 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.263625 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.264127 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: l3-port-ip-change-not-allowed Nov 08 16:02:56.264441 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: l3agentscheduler.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.265444 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.265977 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: l3_agent_scheduler Nov 08 16:02:56.266298 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: logging.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.267792 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.268305 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension logging not supported by any of loaded plugins Nov 08 16:02:56.268628 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: metering.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.269355 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.269944 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: metering Nov 08 16:02:56.270265 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.271473 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.271985 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: metering_source_and_destination_fields Nov 08 16:02:56.272334 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: multiprovidernet.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.273259 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.273791 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: multi-provider Nov 08 16:02:56.274113 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: netmtu.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.275031 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.275529 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: net-mtu Nov 08 16:02:56.275848 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: netmtu_writable.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.276763 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.277254 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: net-mtu-writable Nov 08 16:02:56.277570 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: network_availability_zone.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.278258 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.278752 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: network_availability_zone Nov 08 16:02:56.279065 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: network_ip_availability.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.280173 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.280673 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: network-ip-availability Nov 08 16:02:56.280993 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: network_segment_range.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.281780 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.282280 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension network-segment-range not supported by any of loaded plugins Nov 08 16:02:56.282600 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: pagination.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.283579 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.283908 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: pagination Nov 08 16:02:56.284225 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: port_device_profile.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.285150 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.285653 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: port-device-profile Nov 08 16:02:56.285997 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.286910 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.287411 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: port-mac-address-regenerate Nov 08 16:02:56.288228 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.289173 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.289675 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: port-numa-affinity-policy Nov 08 16:02:56.290019 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: port_resource_request.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.290924 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.291445 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension port-resource-request not supported by any of loaded plugins Nov 08 16:02:56.291759 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: port_resource_request_groups.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.292727 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.293230 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension port-resource-request-groups not supported by any of loaded plugins Nov 08 16:02:56.293544 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: portbindings.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.294506 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.295010 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: binding Nov 08 16:02:56.295323 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: portbindings_extended.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.296590 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.297096 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: binding-extended Nov 08 16:02:56.297416 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: portsecurity.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.298354 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.298855 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: port-security Nov 08 16:02:56.299173 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: project_id.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.300154 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.300479 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: project-id Nov 08 16:02:56.300796 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: providernet.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.301739 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.302244 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: provider Nov 08 16:02:56.302560 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: qos.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.306214 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.306729 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension qos not supported by any of loaded plugins Nov 08 16:02:56.307057 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.308301 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.308807 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Nov 08 16:02:56.309130 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.310070 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.310578 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Nov 08 16:02:56.310897 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: qos_default.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.311805 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.312314 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension qos-default not supported by any of loaded plugins Nov 08 16:02:56.312634 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: qos_fip.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.313283 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.313803 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension qos-fip not supported by any of loaded plugins Nov 08 16:02:56.314120 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: qos_gateway_ip.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.315040 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.315536 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension qos-gateway-ip not supported by any of loaded plugins Nov 08 16:02:56.315852 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: qos_port_network_policy.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.316758 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.317255 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension qos-port-network-policy not supported by any of loaded plugins Nov 08 16:02:56.317570 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.318647 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.319702 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension qos-pps-minimum not supported by any of loaded plugins Nov 08 16:02:56.320021 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: qos_pps_rule.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.321198 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.321915 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension qos-pps not supported by any of loaded plugins Nov 08 16:02:56.322240 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: qos_rule_type_details.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.323154 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.323660 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension qos-rule-type-details not supported by any of loaded plugins Nov 08 16:02:56.323977 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: qos_rules_alias.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.325030 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.325531 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension qos-rules-alias not supported by any of loaded plugins Nov 08 16:02:56.325887 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: quota_check_limit.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.326795 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.327295 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: quota-check-limit Nov 08 16:02:56.327611 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: quotasv2.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.328512 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.328833 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: quotas Nov 08 16:02:56.329148 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: quotasv2_detail.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.332253 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.332596 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: quota_details Nov 08 16:02:56.332924 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: rbac.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.334010 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.334527 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: rbac-policies Nov 08 16:02:56.334895 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: rbac_address_group.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.335859 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.336367 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: rbac-address-group Nov 08 16:02:56.336685 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: rbac_address_scope.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.337610 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.338147 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: rbac-address-scope Nov 08 16:02:56.338465 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: rbac_security_groups.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.339401 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.339910 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: rbac-security-groups Nov 08 16:02:56.340226 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: rbac_subnetpool.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.341149 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.341652 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: rbac-subnetpool Nov 08 16:02:56.341995 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: revisionifmatch.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.342911 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.343421 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: revision-if-match Nov 08 16:02:56.343736 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: revisions.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.344854 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.345361 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: standard-attr-revisions Nov 08 16:02:56.345673 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: router_availability_zone.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.346357 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.346854 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: router_availability_zone Nov 08 16:02:56.347167 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: routerservicetype.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.348072 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.348565 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension router-service-type not supported by any of loaded plugins Nov 08 16:02:56.348878 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.349817 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.350845 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: security-groups-normalized-cidr Nov 08 16:02:56.351159 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: security_groups_port_filtering.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.352161 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.352659 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: port-security-groups-filtering Nov 08 16:02:56.352973 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.353923 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.354423 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: security-groups-remote-address-group Nov 08 16:02:56.354736 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: security_groups_shared_filtering.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.355667 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.356165 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: security-groups-shared-filtering Nov 08 16:02:56.356479 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.357055 dv-cinder-816187-2-iscsi neutron-server[101137]: WARNING neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Nov 08 16:02:56.357366 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: securitygroup.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.368116 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.368637 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: security-group Nov 08 16:02:56.368964 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: segment.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.369761 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.370266 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension segment not supported by any of loaded plugins Nov 08 16:02:56.370587 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.371776 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.372280 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Nov 08 16:02:56.372600 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: servicetype.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.373730 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.374240 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: service-type Nov 08 16:02:56.374563 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: sorting.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.375552 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.375882 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: sorting Nov 08 16:02:56.376201 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: standard_attr_segment.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.377124 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.377632 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension standard-attr-segment not supported by any of loaded plugins Nov 08 16:02:56.377971 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: standardattrdescription.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.378623 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.379125 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: standard-attr-description Nov 08 16:02:56.379442 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: stateful_security_group.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.380362 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.380867 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: stateful-security-group Nov 08 16:02:56.381181 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: stdattrs_common.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.382278 dv-cinder-816187-2-iscsi neutron-server[101137]: WARNING neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Nov 08 16:02:56.382594 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.383525 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.384028 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Nov 08 16:02:56.384341 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: subnet_onboard.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.385413 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.385945 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: subnet_onboard Nov 08 16:02:56.386265 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.387194 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.387694 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Nov 08 16:02:56.388009 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: subnet_service_types.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.388935 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.389440 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: subnet-service-types Nov 08 16:02:56.389779 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: subnetallocation.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.390862 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.391367 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: subnet_allocation Nov 08 16:02:56.391686 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.392350 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.392850 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: subnetpool-prefix-ops Nov 08 16:02:56.393164 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.394141 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.394643 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Nov 08 16:02:56.394958 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: tagging.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.396007 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.396511 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: standard-attr-tag Nov 08 16:02:56.396828 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: timestamp.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.398106 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.398617 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loaded extension: standard-attr-timestamp Nov 08 16:02:56.398938 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: trunk.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.399968 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.400478 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension trunk not supported by any of loaded plugins Nov 08 16:02:56.400799 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: trunk_details.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.401731 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.402243 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension trunk-details not supported by any of loaded plugins Nov 08 16:02:56.402563 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: uplink_status_propagation.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.403499 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.403997 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension uplink-status-propagation not supported by any of loaded plugins Nov 08 16:02:56.404314 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Loading extension file: vlantransparent.py {{(pid=101137) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 16:02:56.404971 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=101137) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 16:02:56.405472 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extension vlan-transparent not supported by any of loaded plugins Nov 08 16:02:56.407945 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Creating instance of TrackedResource for resource:network Nov 08 16:02:56.408471 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Creating instance of TrackedResource for resource:subnet Nov 08 16:02:56.408869 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Creating instance of TrackedResource for resource:subnetpool Nov 08 16:02:56.409261 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Creating instance of TrackedResource for resource:port Nov 08 16:02:56.410530 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.v2.resource_helper [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=101137) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 16:02:56.410972 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.v2.resource_helper [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Service FLAVORS assigned prefix: {{(pid=101137) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 16:02:56.411578 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.v2.resource_helper [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=101137) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 16:02:56.412018 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.v2.resource_helper [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=101137) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 16:02:56.412344 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Creating instance of TrackedResource for resource:router Nov 08 16:02:56.413295 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Creating instance of TrackedResource for resource:floatingip Nov 08 16:02:56.413809 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.v2.resource_helper [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Service METERING assigned prefix: /metering {{(pid=101137) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 16:02:56.415236 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.415596 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.415948 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101137) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:02:56.416928 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Creating instance of CountableResource for resource:rbac_policy Nov 08 16:02:56.417362 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Creating instance of TrackedResource for resource:security_group Nov 08 16:02:56.417824 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 08 16:02:56.418436 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.v2.resource_helper [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Service CORE assigned prefix: {{(pid=101137) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 16:02:56.418897 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Creating instance of TrackedResource for resource:subnetpool Nov 08 16:02:56.419244 dv-cinder-816187-2-iscsi neutron-server[101137]: WARNING neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] subnetpool is already registered Nov 08 16:02:56.419663 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.v2.resource_helper [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Service CORE assigned prefix: {{(pid=101137) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 16:02:56.419989 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Creating instance of TrackedResource for resource:subnetpool Nov 08 16:02:56.420314 dv-cinder-816187-2-iscsi neutron-server[101137]: WARNING neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] subnetpool is already registered Nov 08 16:02:56.422718 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.v2.resource_helper [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=101137) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 16:02:56.423160 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.v2.resource_helper [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Service FLAVORS assigned prefix: {{(pid=101137) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 16:02:56.423782 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.v2.resource_helper [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=101137) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 16:02:56.424202 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.v2.resource_helper [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=101137) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 16:02:56.424541 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Creating instance of TrackedResource for resource:router Nov 08 16:02:56.424875 dv-cinder-816187-2-iscsi neutron-server[101137]: WARNING neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] router is already registered Nov 08 16:02:56.425295 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Creating instance of TrackedResource for resource:floatingip Nov 08 16:02:56.425639 dv-cinder-816187-2-iscsi neutron-server[101137]: WARNING neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] floatingip is already registered Nov 08 16:02:56.426136 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.v2.resource_helper [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Service METERING assigned prefix: /metering {{(pid=101137) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 16:02:56.426831 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Creating instance of CountableResource for resource:rbac_policy Nov 08 16:02:56.427155 dv-cinder-816187-2-iscsi neutron-server[101137]: WARNING neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] rbac_policy is already registered Nov 08 16:02:56.427571 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Creating instance of TrackedResource for resource:security_group Nov 08 16:02:56.427913 dv-cinder-816187-2-iscsi neutron-server[101137]: WARNING neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] security_group is already registered Nov 08 16:02:56.428948 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 08 16:02:56.429294 dv-cinder-816187-2-iscsi neutron-server[101137]: WARNING neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] security_group_rule is already registered Nov 08 16:02:56.429806 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.v2.resource_helper [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Service CORE assigned prefix: {{(pid=101137) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 16:02:56.430140 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Creating instance of TrackedResource for resource:subnetpool Nov 08 16:02:56.430467 dv-cinder-816187-2-iscsi neutron-server[101137]: WARNING neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] subnetpool is already registered Nov 08 16:02:56.430879 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.v2.resource_helper [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Service CORE assigned prefix: {{(pid=101137) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 16:02:56.431195 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Creating instance of TrackedResource for resource:subnetpool Nov 08 16:02:56.431520 dv-cinder-816187-2-iscsi neutron-server[101137]: WARNING neutron.quota.resource_registry [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] subnetpool is already registered Nov 08 16:02:56.433203 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: extensions {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.434764 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: address-groups {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.436207 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: address-scopes {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.437404 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: agents {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.438681 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: auto-allocated-topology {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.439908 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: availability_zones {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.441110 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: dhcp-networks {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.442548 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: dhcp-agents {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.444092 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: routers {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.446220 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: flavors {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.447514 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: service_profiles {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.448722 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: next_providers {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.450172 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: service_profiles {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.452369 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: floatingip-pools {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.454505 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: routers {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.456851 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: floatingips {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.458163 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: l3-routers {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.459630 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: l3-agents {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.461025 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: metering-labels {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.462303 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: metering-label-rules {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.463708 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: network-ip-availabilities {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.464943 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: bindings {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.466555 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: quotas {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.468194 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: quotas {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.469734 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: rbac-policies {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.470929 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: security-groups {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.472243 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: security-group-rules {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.473535 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: service-providers {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.474761 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: subnetpools {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.476686 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: subnetpools {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.478178 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: tags {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.479844 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: tags {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.481659 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: tags {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.483440 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: tags {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.485137 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: tags {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.487115 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: tags {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.488789 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: tags {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.492109 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: tags {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.493923 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: tags {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.495641 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron.api.extensions [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Extended resource: tags {{(pid=101137) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 16:02:56.502091 dv-cinder-816187-2-iscsi neutron-server[101137]: WARNING keystonemiddleware.auth_token [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 08 16:02:56.506641 dv-cinder-816187-2-iscsi neutron-server[101137]: WARNING keystonemiddleware.auth_token [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 08 16:02:56.515385 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_concurrency.lockutils [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Acquired lock "singleton_lock" {{(pid=101137) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 08 16:02:56.515860 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_concurrency.lockutils [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Releasing lock "singleton_lock" {{(pid=101137) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 08 16:02:56.516503 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO oslo_service.service [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Starting 2 workers Nov 08 16:02:56.521325 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Started child 101244 {{(pid=101137) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 08 16:02:56.526483 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Started child 101245 {{(pid=101137) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 08 16:02:56.526836 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:02:56.527457 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO neutron.service [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Neutron service started, listening on 0.0.0.0:9696 Nov 08 16:02:56.527936 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Publish callbacks [] for process, before_spawn {{(pid=101137) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:02:56.528440 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [-] (101244) wsgi starting up on http://0.0.0.0:9696 Nov 08 16:02:56.530432 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO oslo_service.service [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Starting 1 workers Nov 08 16:02:56.530592 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:02:56.531953 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [-] (101245) wsgi starting up on http://0.0.0.0:9696 Nov 08 16:02:56.535613 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Started child 101246 {{(pid=101137) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 08 16:02:56.536148 dv-cinder-816187-2-iscsi neutron-server[101137]: INFO oslo_service.service [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Starting 1 workers Nov 08 16:02:56.539830 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.service [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] calling RpcWorker wait() {{(pid=101246) _wait /opt/stack/neutron/neutron/service.py:128}} Nov 08 16:02:56.540388 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.service [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] returning from RpcWorker wait() {{(pid=101246) _wait /opt/stack/neutron/neutron/service.py:135}} Nov 08 16:02:56.541095 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Started child 101247 {{(pid=101137) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 08 16:02:56.541677 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:02:56.541894 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG neutron_lib.callbacks.manager [None req-3e504e68-854c-468a-b60f-016e50fadc51 None None] Publish callbacks [] for process, after_spawn {{(pid=101137) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:02:56.542266 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:02:56.543816 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=101137) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 08 16:02:56.544028 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 08 16:02:56.544211 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 08 16:02:56.544424 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 08 16:02:56.544754 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 08 16:02:56.544911 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 08 16:02:56.545427 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.545701 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.545971 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.546073 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:02:56.546522 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.546522 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.547042 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.547140 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:02:56.547295 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.547542 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.547810 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.548059 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.548224 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.548386 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.548624 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.548870 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.549162 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.549411 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.549650 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.549949 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.550121 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.550376 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] config_source = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.550652 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.550902 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.551168 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] debug = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.551416 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.551877 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.552101 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.552345 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.552579 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.552862 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.553103 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.553983 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.554209 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.554422 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.554653 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.554907 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.555145 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.555368 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.555624 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.555834 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.556072 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.556290 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.556742 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] host = dv-cinder-816187-2-iscsi {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.556961 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.557199 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.557435 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.557676 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.557955 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.558165 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.558411 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.558663 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.558897 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.559131 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.559372 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.559623 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.559850 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] log_dir = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.560095 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] log_file = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.560254 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] log_options = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.560493 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.560769 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.561017 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.561206 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.561369 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.561543 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.561816 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.561977 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.562221 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.562436 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.562645 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.562907 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.563092 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.563305 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.563553 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.563767 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.563993 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.564199 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.564458 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.564679 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.564900 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.565139 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.565387 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.565641 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.565887 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.566098 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.566335 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.566547 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.566782 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.567028 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.567272 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.567562 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.567749 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.567983 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.568233 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.568473 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.568694 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.568948 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.569216 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.569435 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.569702 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.569936 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.570145 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.570384 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.570593 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.570818 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] use_journal = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.571046 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] use_json = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.571253 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.571493 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.571731 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.571939 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.572167 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.572375 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.572582 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.572805 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.573234 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.573506 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.573835 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.574077 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.574309 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.574555 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.574780 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.574994 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.575234 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.575462 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.576695 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.576695 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.576695 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.577076 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.577076 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.577350 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.577679 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.577909 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.578860 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.578860 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.578860 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.579122 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.579358 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.579575 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.579819 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.580421 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.580675 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.581083 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.581588 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.581588 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.37/identity {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.582239 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.582239 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.582239 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.582645 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.582645 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.582906 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.583042 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.583285 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.583620 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.583778 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.584007 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.584814 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.584814 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.584814 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.588724 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.588724 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.588724 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.588724 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.588724 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.588724 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.588724 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.588724 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.588724 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.592316 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.592316 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.592316 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.592316 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.592316 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.592316 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.592316 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.592316 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.592316 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.594541 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.594541 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.594541 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.594541 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.594541 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.594541 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.594541 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.594541 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.594541 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.595178 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.595178 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.595178 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.595178 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.595178 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.595178 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.595178 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.595178 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.595178 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.595799 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.595799 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.595799 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.595799 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.595799 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.595799 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.595799 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.595799 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.595799 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.596502 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.596502 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.596502 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.596502 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.596502 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.596878 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.596958 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.597185 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.598880 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.599122 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.599374 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.599635 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.599877 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.600149 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.600905 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.601794 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.603419 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.604986 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.606024 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.606261 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.606528 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.606787 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.607075 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.607321 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.607568 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.607812 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.608074 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.608356 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.608582 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.608868 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.609112 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.609386 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.609726 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.610261 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.610562 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.611573 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.611829 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.612112 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.612350 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.612622 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.613639 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.613908 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.614154 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.614454 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.614707 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.614929 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.615167 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.615420 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.615751 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.616569 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.616788 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.617004 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.617266 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.617533 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.617810 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.618072 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.618319 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.618584 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.618828 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.619055 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.37/identity {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.619268 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.619505 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.619746 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.620112 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.620479 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.621101 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.621492 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.621873 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.622271 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.622531 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.622747 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.622962 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.623352 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.623728 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.624088 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.624471 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.624853 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.626780 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.627882 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.628119 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.628347 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.628573 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.628812 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.629065 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.629289 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.629570 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.629847 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.630098 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.630327 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.630555 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.630805 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.631020 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.631266 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.631532 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.631745 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.631957 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.632195 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.632407 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.632646 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.632870 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.633082 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.633314 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.633559 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.635181 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.635452 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.636040 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.636725 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.636977 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.637778 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.638074 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.638331 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.638562 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.638788 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.639012 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.639360 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.639710 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.639959 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.640193 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.640435 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.641277 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.641500 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.642055 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.642388 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.642665 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.642912 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.643183 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.643437 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.643674 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.643920 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.644143 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.644358 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.644582 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.644802 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.645015 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.645247 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.645914 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.646129 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.646355 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.646574 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.646785 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.647583 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.647800 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.648009 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.648275 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.648492 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.648777 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.648919 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.649131 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.649340 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.649557 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.650317 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.650535 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.650785 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.650990 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.651442 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.651671 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.651983 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.652098 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.652363 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.652617 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.652833 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.653113 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.653358 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.653601 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.654190 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.654513 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.654728 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.654962 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.655196 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.655411 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.655627 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.655874 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.656199 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.656471 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.656740 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.656990 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.657303 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.657582 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:150:199'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.657880 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.658094 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.658392 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.658713 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.658977 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.659243 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.659495 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.659737 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.659955 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.660169 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.660412 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.660644 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.660860 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.661113 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.661346 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.661575 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.661837 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.662063 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.662978 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.662978 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.662978 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.663240 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.663240 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.663385 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 08 16:02:56.664600 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=101137) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 08 16:02:56.665164 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 08 16:02:56.665164 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 08 16:02:56.665336 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 08 16:02:56.665425 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 08 16:02:56.665506 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 08 16:02:56.665747 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.665888 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.666046 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.666208 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.666365 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.666543 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.666703 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.666894 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.666992 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.667153 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.667303 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.667618 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.667779 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.667935 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.668095 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.668249 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.668404 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.668559 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.668720 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.668875 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] config_source = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.669029 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.669182 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.669336 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] debug = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.669491 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.669690 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.669874 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.670028 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.670183 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.670334 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.670484 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.670639 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.670794 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.670949 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.671105 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.671264 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.671590 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.671750 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.671908 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.672062 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.672222 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.672374 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.672528 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] host = dv-cinder-816187-2-iscsi {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.672683 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.672837 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.672990 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.673145 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.673301 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.673456 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.673609 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.673783 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.673933 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.674094 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.674245 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.674401 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.674575 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] log_dir = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.674707 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] log_file = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.674857 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] log_options = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.675011 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.675165 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.675340 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.675498 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.675659 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.675813 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.675967 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.676121 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.676298 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.676431 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.676601 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.676749 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.676889 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.677030 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.677199 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.677337 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.677492 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.677647 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.677824 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.677978 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.678131 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.678777 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.678945 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.679103 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.679292 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.679451 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.679603 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.679759 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.679908 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.680062 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.680214 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.680368 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.680545 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.680683 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.680814 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.680955 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.681112 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.681285 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.681425 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.681580 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.681798 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.681898 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.682048 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.682201 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.682355 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.682508 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] use_journal = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.682661 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] use_json = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.682816 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.682974 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.683130 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.683896 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.683896 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.683896 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.683896 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.683896 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 16:02:56.684256 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.684256 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.684392 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.684481 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.684609 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.684812 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.684905 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.689743 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.689743 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.689743 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.689743 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.689743 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.689743 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.689743 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.689743 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.690342 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:02:56.690428 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.690428 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.690428 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.690428 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.690428 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.690428 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.690428 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.690428 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.690943 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.690943 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.690943 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.690943 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.690943 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.690943 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.690943 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.37/identity {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.690943 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.691436 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.691436 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.691436 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.691436 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.691436 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.691436 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.691436 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.691436 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.691436 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.692108 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.692108 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.692108 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.692108 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.692108 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.692108 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.692108 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.692108 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.692630 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.692630 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.692630 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.692630 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.692630 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.692630 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.692630 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.692630 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.692630 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.693228 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.693228 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.693228 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.693228 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.693228 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.693228 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.693625 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.693625 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.693625 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.693840 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.693930 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.694076 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.694235 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.694395 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.694551 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.694709 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.694867 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.695024 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.695181 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.695339 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.695496 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.695659 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.695817 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.695973 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.696129 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.696287 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.696445 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.696602 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.696759 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.697602 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.697602 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.697602 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.697602 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.697602 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.698022 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.698104 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.698495 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.698495 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.698668 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.698748 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.698964 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.699123 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.699277 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.699432 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.699583 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.699738 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.699903 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.700058 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.700217 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.700374 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.700531 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.700687 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.700842 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.701159 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.701461 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.701770 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.702066 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.702364 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.702526 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.702695 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.702854 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.703014 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.703176 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.703343 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.703512 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.703669 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.703825 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.704124 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.704434 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.704729 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.705024 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.705326 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.705485 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.705644 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.705837 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.705994 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.706162 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.706327 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.706462 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.706627 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.706804 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.706961 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.707117 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.707274 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.707430 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.707587 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.707743 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.707899 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.708057 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.708214 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.708370 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.708528 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.37/identity {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.708686 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.708842 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.708999 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.709149 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.709302 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.709453 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.710146 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.710293 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.710461 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.710610 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.710808 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.710944 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.711273 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.712113 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.712113 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.712113 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.712113 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.712113 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.712516 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.712516 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.712516 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.712741 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.712741 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.712900 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.713036 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.713198 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.713367 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.713512 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.713621 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.713809 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.713969 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.714126 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.714286 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.714443 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.714601 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.714758 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.714917 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.715075 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.715233 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.715392 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.715550 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.715706 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.715880 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.716102 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.716217 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.716373 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.716530 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.716688 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.716846 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.717002 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.717159 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.717315 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.717471 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.717627 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.717805 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.717966 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.718125 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.718281 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.718438 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.718595 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.718751 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.718909 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.719080 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.719240 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.719397 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.719556 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.719714 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.719869 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.720037 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.720195 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.720351 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.720507 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.720664 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.720821 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.720987 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.721147 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.721303 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.721460 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.721616 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.721798 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.721966 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.722124 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.722281 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.722437 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.722594 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.722751 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.722916 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.723074 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.723425 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.723520 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.723640 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.723826 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.726660 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.726660 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.726660 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.726660 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.726660 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.726660 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.726660 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.726660 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.727248 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.727248 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.727248 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.727248 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.727248 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.727248 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.727248 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.727248 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.727795 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.727795 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.727795 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.727795 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.727795 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.727795 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.727795 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.728264 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.728264 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.728264 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:150:199'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.728264 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.728533 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.728618 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.728913 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.728913 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.729072 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.729175 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.729332 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.729492 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.729649 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.729829 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.729987 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.730368 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.730368 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.730513 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.730591 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.730718 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.730934 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.731092 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.731248 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.731416 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.731549 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.731705 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 16:02:56.731858 dv-cinder-816187-2-iscsi neutron-server[101137]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 08 16:02:56.924167 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 57620) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:02:56.933064 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [-] 10.222.0.37 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0067198 Nov 08 16:03:08.149177 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-91b94ff9-8916-49bf-9ae5-66009529c1db None None] get_active_networks_info from dv-cinder-816187-2-iscsi {{(pid=101246) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 08 16:03:08.230598 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91b94ff9-8916-49bf-9ae5-66009529c1db None None] No non-hosted networks {{(pid=101246) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Nov 08 16:03:08.239068 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.agentschedulers_db [None req-91b94ff9-8916-49bf-9ae5-66009529c1db None None] DHCP Agent not found on host dv-cinder-816187-2-iscsi {{(pid=101246) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Nov 08 16:03:08.309072 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-b6c1f763-02f9-4c7d-b67e-c59de65a2f64 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-2034664'] for agent, after_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:10.558218 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-482274e9-3f39-478b-a0a4-862258965416 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-2034664'] for agent, after_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:10.605284 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-c9c64d5c-f23f-4730-9fb9-8e74db68bae3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:11.511618 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-2034664'] for agent, after_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:13.285226 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-2034664'] for agent, after_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:13.924741 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-2034664'] for agent, after_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:13.926859 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:13.928690 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:13.929335 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:13.929910 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:13.930861 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:13.931674 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:13.932192 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:13.932724 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:13.933392 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:13.933906 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:13.934413 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:13.934966 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:13.935876 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-816187-2-iscsi', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:03:13.947414 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-816187-2-iscsi', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:03:14.341354 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.db.l3_hamode_db [None req-b3970a15-6295-4ba6-b3c7-6d3d95d6a0b8 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Nov 08 16:03:14.416868 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3970a15-6295-4ba6-b3c7-6d3d95d6a0b8 None None] Routers set() bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:03:14.417239 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3970a15-6295-4ba6-b3c7-6d3d95d6a0b8 None None] Router IDs set() for agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 08 16:03:14.456915 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 57712) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:03:14.950044 dv-cinder-816187-2-iscsi neutron-server[101244]: WARNING oslo_policy.policy [None req-f5e2a5ea-c0e8-4676-990b-eae59f0696ef admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 08 16:03:14.950717 dv-cinder-816187-2-iscsi neutron-server[101244]: WARNING oslo_policy.policy [None req-f5e2a5ea-c0e8-4676-990b-eae59f0696ef admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 08 16:03:15.177189 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [None req-f5e2a5ea-c0e8-4676-990b-eae59f0696ef admin admin] http://10.222.0.37:9696/v2.0/extensions returned with HTTP 200 {{(pid=101244) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 16:03:15.178556 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-f5e2a5ea-c0e8-4676-990b-eae59f0696ef admin admin] 10.222.0.37 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7196119 Nov 08 16:03:17.665190 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 57728) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:03:17.967407 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-75eccb5f-1869-4b6b-a7a2-6d7992c02121 admin admin] Request body: {'subnetpool': {'is_default': True, 'shared': True, 'name': 'shared-default-subnetpool-v4', 'default_prefixlen': 26, 'prefixes': ['172.20.0.0/16']}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:03:18.063409 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.policy [None req-75eccb5f-1869-4b6b-a7a2-6d7992c02121 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=101244) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 08 16:03:18.109389 dv-cinder-816187-2-iscsi neutron-server[101244]: WARNING oslo_policy.policy [None req-75eccb5f-1869-4b6b-a7a2-6d7992c02121 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 08 16:03:18.109771 dv-cinder-816187-2-iscsi neutron-server[101244]: WARNING oslo_policy.policy [None req-75eccb5f-1869-4b6b-a7a2-6d7992c02121 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 08 16:03:18.118842 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.quota [None req-75eccb5f-1869-4b6b-a7a2-6d7992c02121 admin admin] Loaded quota_driver: . Nov 08 16:03:18.205674 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-75eccb5f-1869-4b6b-a7a2-6d7992c02121 admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8792878384192', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8792878385775', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8792878445788', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8792878433048', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8792879021092', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8792878419606', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-1007093', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-906448', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1753758', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1826453'] for rbac-policy, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:18.269997 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-75eccb5f-1869-4b6b-a7a2-6d7992c02121 admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:18.271179 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-75eccb5f-1869-4b6b-a7a2-6d7992c02121 admin admin] 10.222.0.37 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.6049728 Nov 08 16:03:20.924707 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 57740) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:03:21.216127 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Request body: {'network': {'project_id': '7525c72c09024c009f7dd23c611dca3c', 'admin_state_up': True, 'tenant_id': '7525c72c09024c009f7dd23c611dca3c', 'name': 'private'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:03:21.243463 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Made reservation on behalf of 7525c72c09024c009f7dd23c611dca3c for: {'network': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:03:21.246635 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for network, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:21.262621 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:21.367592 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:21.371512 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:21.390866 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] vlan segment allocate from pool success with {'vlan_id': 157, 'physical_network': 'physnet1'} {{(pid=101244) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 16:03:21.415659 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8792877333288', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:21.416220 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Unsubscribe: segment precommit_create {{(pid=101244) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 08 16:03:21.416729 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.db.segments_db [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Added segment df471971-2b53-43f7-908f-98840800a77e of type vlan for network bb51f8ce-3a1d-4770-95c3-615428fadbc5 Nov 08 16:03:21.435617 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d73241f2-69d0-4e7f-9920-9c95ac082d34,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:03:21.481064 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:21.481423 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:21.481778 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:21.482106 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:21.482427 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:21.482760 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:21.483093 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:21.483406 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:21.483738 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:21.484050 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:21.484357 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:21.484663 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Tracked resource versions report: Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: pushed versions: Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: { 'AddressGroup': {'1.2'}, Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: 'ConntrackHelper': {'1.0'}, Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: 'Log': {'1.0'}, Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: 'Network': {'1.1'}, Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: 'Port': {'1.7'}, Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: 'PortForwarding': {'1.2'}, Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: 'QosPolicy': {'1.10'}, Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: 'SecurityGroup': {'1.5'}, Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: 'SecurityGroupRule': {'1.2'}, Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: 'SubPort': {'1.0'}, Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: 'Subnet': {'1.1'}, Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: 'Trunk': {'1.1'}} Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: consumer versions: Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: { DHCP agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: L3 agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: Metadata agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: Metering agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: Open vSwitch agent@dv-cinder-816187-2-iscsi: { 'AddressGroup': '1.2', Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: 'ConntrackHelper': '1.0', Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: 'Log': '1.0', Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: 'Network': '1.1', Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: 'Port': '1.7', Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: 'PortForwarding': '1.2', Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: 'QosPolicy': '1.10', Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: 'SecurityGroup': '1.5', Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: 'SecurityGroupRule': '1.2', Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: 'SubPort': '1.0', Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: 'Subnet': '1.1', Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: 'Trunk': '1.1'}} Nov 08 16:03:21.485827 dv-cinder-816187-2-iscsi neutron-server[101244]: {{(pid=101244) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 08 16:03:21.534147 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792876766172'] for network, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:21.574090 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for network, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:21.575476 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:03:21.576233 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:21.657950 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] 10.222.0.37 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.7320957 Nov 08 16:03:21.675243 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a28d0019-c83f-468a-9c52-dd16750d19d5 admin admin] Pushing event updated for resources: {'Network': ['ID=bb51f8ce-3a1d-4770-95c3-615428fadbc5,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:03:21.688210 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Network bb51f8ce-3a1d-4770-95c3-615428fadbc5 details requested by agent ovs-agent-dv-cinder-816187-2-iscsi with host dv-cinder-816187-2-iscsi {{(pid=101246) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 16:03:24.424902 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 57754) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:03:24.906287 dv-cinder-816187-2-iscsi neutron-server[101245]: WARNING oslo_policy.policy [None req-2cdd1e91-3e83-4aa1-8ba9-be612592f1e0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 08 16:03:24.906864 dv-cinder-816187-2-iscsi neutron-server[101245]: WARNING oslo_policy.policy [None req-2cdd1e91-3e83-4aa1-8ba9-be612592f1e0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 08 16:03:25.345473 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.policy [None req-2cdd1e91-3e83-4aa1-8ba9-be612592f1e0 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=101245) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 08 16:03:25.392370 dv-cinder-816187-2-iscsi neutron-server[101245]: WARNING oslo_policy.policy [None req-2cdd1e91-3e83-4aa1-8ba9-be612592f1e0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 08 16:03:25.392727 dv-cinder-816187-2-iscsi neutron-server[101245]: WARNING oslo_policy.policy [None req-2cdd1e91-3e83-4aa1-8ba9-be612592f1e0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 08 16:03:25.401268 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2cdd1e91-3e83-4aa1-8ba9-be612592f1e0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:03:25.403020 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-2cdd1e91-3e83-4aa1-8ba9-be612592f1e0 admin admin] 10.222.0.37 "GET /v2.0/networks/bb51f8ce-3a1d-4770-95c3-615428fadbc5 HTTP/1.1" status: 200 len: 825 time: 0.9772139 Nov 08 16:03:25.440955 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-8e30f86c-e5f5-46d2-8e5d-8c6b760c6258 admin admin] 10.222.0.37 "GET /v2.0/subnetpools/806a3da9-d625-4b24-bff0-75bba8e3f2da HTTP/1.1" status: 200 len: 734 time: 0.0317349 Nov 08 16:03:25.450144 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Request body: {'subnet': {'subnetpool_id': '806a3da9-d625-4b24-bff0-75bba8e3f2da', 'name': 'private-subnet', 'ip_version': 4, 'tenant_id': '7525c72c09024c009f7dd23c611dca3c', 'gateway_ip': '172.20.0.1', 'network_id': 'bb51f8ce-3a1d-4770-95c3-615428fadbc5'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:03:25.451703 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.quota [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Loaded quota_driver: . Nov 08 16:03:25.488799 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Made reservation on behalf of 7525c72c09024c009f7dd23c611dca3c for: {'subnet': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:03:25.491753 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Publish callbacks [] for subnet, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:25.772273 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for subnet, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:25.839452 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Checking segment: {'id': 'df471971-2b53-43f7-908f-98840800a77e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': 'bb51f8ce-3a1d-4770-95c3-615428fadbc5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:03:25.839813 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Network hostable DHCP agents. Network: bb51f8ce-3a1d-4770-95c3-615428fadbc5, hostable agents: ['a7e1e7ee-1ce2-474e-9688-58f0884991a4'], hosted agents: [] {{(pid=101245) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 16:03:25.852048 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e932d62b-b59a-44b3-98c4-0ae9e9a80867,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:03:25.864735 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:25.865098 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:25.865423 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:25.865761 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:25.866077 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:25.866402 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:25.866715 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:25.867036 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:25.867359 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:25.867666 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:25.867967 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:25.868267 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Tracked resource versions report: Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: pushed versions: Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: { 'AddressGroup': {'1.2'}, Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: 'ConntrackHelper': {'1.0'}, Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: 'Log': {'1.0'}, Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: 'Network': {'1.1'}, Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: 'Port': {'1.7'}, Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: 'PortForwarding': {'1.2'}, Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: 'QosPolicy': {'1.10'}, Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: 'SecurityGroup': {'1.5'}, Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: 'SecurityGroupRule': {'1.2'}, Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: 'SubPort': {'1.0'}, Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: 'Subnet': {'1.1'}, Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: 'Trunk': {'1.1'}} Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: consumer versions: Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: { DHCP agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: L3 agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: Metadata agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: Metering agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: Open vSwitch agent@dv-cinder-816187-2-iscsi: { 'AddressGroup': '1.2', Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: 'ConntrackHelper': '1.0', Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: 'Log': '1.0', Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: 'Network': '1.1', Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: 'Port': '1.7', Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: 'PortForwarding': '1.2', Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: 'QosPolicy': '1.10', Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: 'SecurityGroup': '1.5', Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: 'SecurityGroupRule': '1.2', Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: 'SubPort': '1.0', Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: 'Subnet': '1.1', Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: 'Trunk': '1.1'}} Nov 08 16:03:25.869314 dv-cinder-816187-2-iscsi neutron-server[101245]: {{(pid=101245) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 08 16:03:25.901111 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Network bb51f8ce-3a1d-4770-95c3-615428fadbc5 is scheduled to be hosted by DHCP agent a7e1e7ee-1ce2-474e-9688-58f0884991a4 with binding_index 1 {{(pid=101245) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 16:03:25.913635 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816187-2-iscsi, bb51f8ce-3a1d-4770-95c3-615428fadbc5) {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:03:25.917885 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:03:25.918495 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for subnet, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:25.923297 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97b2f8a9-8fa1-4e29-affe-5c9597fddbe8 None None] Network bb51f8ce-3a1d-4770-95c3-615428fadbc5 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:03:25.938557 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-d90d99cd-e3db-4e12-bf00-a8a580c01b48 admin admin] 10.222.0.37 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.4917028 Nov 08 16:03:26.240590 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp66bc375f-c06b-591f-b467-1ee6ff0ebcc7-bb51f8ce-3a1d-4770-95c3-615428fadbc5', 'network_id': 'bb51f8ce-3a1d-4770-95c3-615428fadbc5', 'tenant_id': '7525c72c09024c009f7dd23c611dca3c', 'fixed_ips': [{'subnet_id': 'e932d62b-b59a-44b3-98c4-0ae9e9a80867'}]}} from dv-cinder-816187-2-iscsi. {{(pid=101246) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 08 16:03:26.241978 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:26.530265 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.db_base_plugin_common [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Allocated IP 172.20.0.2 (bb51f8ce-3a1d-4770-95c3-615428fadbc5/e932d62b-b59a-44b3-98c4-0ae9e9a80867/40106071-6de2-4f87-9e6d-63ab9e0eba11) {{(pid=101246) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:03:26.727834 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Publish callbacks [] for port, precommit_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:26.735202 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:26.803685 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Network bb51f8ce-3a1d-4770-95c3-615428fadbc5 is already hosted by enough agents. {{(pid=101246) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:03:26.809166 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.scheduler.base_scheduler [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Resources bound (agent type, host, resource id): {{(pid=101246) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:03:26.821001 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Received port after_create {{(pid=101246) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:03:26.828912 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Pushing event updated for resources: {'Port': ['ID=40106071-6de2-4f87-9e6d-63ab9e0eba11,revision_number=1']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:03:26.874150 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:26.874509 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:26.874855 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:26.875186 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:26.875515 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:26.875839 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:26.876160 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:26.876480 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:26.876813 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:26.877136 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:26.877453 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:26.877788 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Tracked resource versions report: Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: pushed versions: Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: { 'AddressGroup': {'1.2'}, Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: 'ConntrackHelper': {'1.0'}, Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: 'Log': {'1.0'}, Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: 'Network': {'1.1'}, Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: 'Port': {'1.7'}, Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: 'PortForwarding': {'1.2'}, Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: 'QosPolicy': {'1.10'}, Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: 'SecurityGroup': {'1.5'}, Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: 'SecurityGroupRule': {'1.2'}, Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: 'SubPort': {'1.0'}, Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: 'Subnet': {'1.1'}, Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: 'Trunk': {'1.1'}} Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: consumer versions: Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: { DHCP agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: L3 agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: Metadata agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: Metering agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: Open vSwitch agent@dv-cinder-816187-2-iscsi: { 'AddressGroup': '1.2', Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: 'ConntrackHelper': '1.0', Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: 'Log': '1.0', Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: 'Network': '1.1', Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: 'Port': '1.7', Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: 'PortForwarding': '1.2', Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: 'QosPolicy': '1.10', Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: 'SecurityGroup': '1.5', Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: 'SecurityGroupRule': '1.2', Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: 'SubPort': '1.0', Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: 'Subnet': '1.1', Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: 'Trunk': '1.1'}} Nov 08 16:03:26.878863 dv-cinder-816187-2-iscsi neutron-server[101246]: {{(pid=101246) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 08 16:03:26.913405 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Attempting to bind port 40106071-6de2-4f87-9e6d-63ab9e0eba11 on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:03:26.913943 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Attempting to bind port 40106071-6de2-4f87-9e6d-63ab9e0eba11 by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': 'df471971-2b53-43f7-908f-98840800a77e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': 'bb51f8ce-3a1d-4770-95c3-615428fadbc5'}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:03:26.914379 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Attempting to bind port 40106071-6de2-4f87-9e6d-63ab9e0eba11 on network bb51f8ce-3a1d-4770-95c3-615428fadbc5 {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:03:26.919219 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 3, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:03:26.919599 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Checking segment: {'id': 'df471971-2b53-43f7-908f-98840800a77e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': 'bb51f8ce-3a1d-4770-95c3-615428fadbc5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:03:26.920063 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:26.920443 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Bound using segment: {'id': 'df471971-2b53-43f7-908f-98840800a77e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': 'bb51f8ce-3a1d-4770-95c3-615428fadbc5'} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:03:26.920923 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Bound port: 40106071-6de2-4f87-9e6d-63ab9e0eba11, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'df471971-2b53-43f7-908f-98840800a77e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': 'bb51f8ce-3a1d-4770-95c3-615428fadbc5'}}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:03:26.921319 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:26.980618 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] For port 40106071-6de2-4f87-9e6d-63ab9e0eba11, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:03:26.984774 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] For port 40106071-6de2-4f87-9e6d-63ab9e0eba11, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=40106071-6de2-4f87-9e6d-63ab9e0eba11,segment=NetworkSegment(df471971-2b53-43f7-908f-98840800a77e),segment_id=df471971-2b53-43f7-908f-98840800a77e)] {{(pid=101246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:03:26.989191 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:27.056154 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4e2dbc5-ca92-4756-a74a-6900645b497a None None] Pushing event updated for resources: {'Port': ['ID=40106071-6de2-4f87-9e6d-63ab9e0eba11,revision_number=2']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:03:28.442893 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 57774) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:03:28.752362 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [None req-92abc09d-ea98-4ab8-b0d6-53e62efbc2b5 admin admin] http://10.222.0.37:9696/v2.0/extensions returned with HTTP 200 {{(pid=101245) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 16:03:28.753341 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-92abc09d-ea98-4ab8-b0d6-53e62efbc2b5 admin admin] 10.222.0.37 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3094063 Nov 08 16:03:31.260068 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 57782) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:03:31.568378 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [None req-757d24cc-27b6-4c13-92fb-b53006206f6f admin admin] http://10.222.0.37:9696/v2.0/extensions returned with HTTP 200 {{(pid=101245) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 16:03:31.569470 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-757d24cc-27b6-4c13-92fb-b53006206f6f admin admin] 10.222.0.37 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3084600 Nov 08 16:03:34.303300 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 57792) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:03:34.597470 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-536d2b8a-701e-4cef-9815-446d1e7f7404 admin admin] Request body: {'router': {'tenant_id': '7525c72c09024c009f7dd23c611dca3c', 'admin_state_up': True, 'name': 'router1'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:03:34.622418 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-536d2b8a-701e-4cef-9815-446d1e7f7404 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-2034701', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-12912'] for router, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:34.623219 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-536d2b8a-701e-4cef-9815-446d1e7f7404 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-2034873', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-2032180', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-2080911', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-12873'] for router, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:34.786540 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-536d2b8a-701e-4cef-9815-446d1e7f7404 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:34.790649 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-536d2b8a-701e-4cef-9815-446d1e7f7404 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-2034870', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-2032353'] for router, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:34.809097 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-536d2b8a-701e-4cef-9815-446d1e7f7404 admin admin] Publish callbacks [] for router, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:34.810295 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-536d2b8a-701e-4cef-9815-446d1e7f7404 admin admin] 10.222.0.37 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.5060232 Nov 08 16:03:35.694395 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 40106071-6de2-4f87-9e6d-63ab9e0eba11 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:03:35.782546 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 40106071-6de2-4f87-9e6d-63ab9e0eba11 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:03:35.782936 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:35.889959 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:35.923234 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] For port 40106071-6de2-4f87-9e6d-63ab9e0eba11, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=40106071-6de2-4f87-9e6d-63ab9e0eba11,segment=NetworkSegment(df471971-2b53-43f7-908f-98840800a77e),segment_id=df471971-2b53-43f7-908f-98840800a77e)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:03:35.927572 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:35.972923 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Pushing event updated for resources: {'Port': ['ID=40106071-6de2-4f87-9e6d-63ab9e0eba11,revision_number=3']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:03:36.106966 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0891669e-b234-4c2f-81d7-c0c5faaba231 None None] Network bb51f8ce-3a1d-4770-95c3-615428fadbc5 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:03:36.225113 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-8fe6f806-d8de-49a3-aa49-5795a768f453 None None] Provisioning complete for port 40106071-6de2-4f87-9e6d-63ab9e0eba11 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:03:36.225395 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-8fe6f806-d8de-49a3-aa49-5795a768f453 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:36.566089 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-ad9f8e50-cc13-4c53-a210-0625985fa775 None None] Provisioning complete for port 40106071-6de2-4f87-9e6d-63ab9e0eba11 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:03:36.566447 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ad9f8e50-cc13-4c53-a210-0625985fa775 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:37.298653 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 57804) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:03:37.599194 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [None req-91048771-b2f6-4166-8321-aa28236b01ee admin admin] http://10.222.0.37:9696/v2.0/extensions returned with HTTP 200 {{(pid=101245) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 16:03:37.600148 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-91048771-b2f6-4166-8321-aa28236b01ee admin admin] 10.222.0.37 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3005607 Nov 08 16:03:37.663640 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 40106071-6de2-4f87-9e6d-63ab9e0eba11 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:03:37.713860 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 40106071-6de2-4f87-9e6d-63ab9e0eba11 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:03:37.714236 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:38.081367 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-f675189c-3b0f-4401-9f0f-3684dc73f8a2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:40.091994 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 57812) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:03:40.402818 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-9e044f62-13fd-4174-9988-10d5767dab88 admin admin] Request body: {'network': {'provider:physical_network': 'physnet1', 'name': 'public', 'admin_state_up': True, 'router:external': True, 'provider:network_type': 'flat', 'is_default': True}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:03:40.426641 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9e044f62-13fd-4174-9988-10d5767dab88 admin admin] Made reservation on behalf of 78c0ac24d03743a587d25bef45bbcf23 for: {'network': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:03:40.428809 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9e044f62-13fd-4174-9988-10d5767dab88 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for network, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:40.442836 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9e044f62-13fd-4174-9988-10d5767dab88 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:40.545050 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9e044f62-13fd-4174-9988-10d5767dab88 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:40.549242 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9e044f62-13fd-4174-9988-10d5767dab88 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:40.551364 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7b028312-4bc8-41dd-b49c-3b27e8f91e7e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:40.566226 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-9e044f62-13fd-4174-9988-10d5767dab88 admin admin] Reserving flat network on physical network physnet1 {{(pid=101245) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Nov 08 16:03:40.590841 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e044f62-13fd-4174-9988-10d5767dab88 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=57fc65f3-0f79-4d42-b74a-fd4902fc87d5,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:03:40.595755 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9e044f62-13fd-4174-9988-10d5767dab88 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8792877333288', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:40.596317 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9e044f62-13fd-4174-9988-10d5767dab88 admin admin] Unsubscribe: segment precommit_create {{(pid=101245) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 08 16:03:40.596787 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.db.segments_db [None req-9e044f62-13fd-4174-9988-10d5767dab88 admin admin] Added segment 5654fd20-eb76-4a3d-8fc2-e37f9aa812c4 of type flat for network 68f46265-b42a-49a0-8d57-f9362045cd9b Nov 08 16:03:40.658037 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9e044f62-13fd-4174-9988-10d5767dab88 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792876766172'] for network, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:40.695742 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9e044f62-13fd-4174-9988-10d5767dab88 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for network, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:40.696691 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9e044f62-13fd-4174-9988-10d5767dab88 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:03:40.697253 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9e044f62-13fd-4174-9988-10d5767dab88 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:40.771594 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-9e044f62-13fd-4174-9988-10d5767dab88 admin admin] 10.222.0.37 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.6784885 Nov 08 16:03:40.789327 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e044f62-13fd-4174-9988-10d5767dab88 admin admin] Pushing event updated for resources: {'Network': ['ID=68f46265-b42a-49a0-8d57-f9362045cd9b,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:03:40.801958 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Network 68f46265-b42a-49a0-8d57-f9362045cd9b details requested by agent ovs-agent-dv-cinder-816187-2-iscsi with host dv-cinder-816187-2-iscsi {{(pid=101246) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 16:03:41.455035 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:43.209688 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 57830) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:03:43.230979 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:43.381914 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ec03b6c-c2d4-4836-9772-49d9796ca397 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:03:43.383197 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-6ec03b6c-c2d4-4836-9772-49d9796ca397 admin admin] 10.222.0.37 "GET /v2.0/subnets/e932d62b-b59a-44b3-98c4-0ae9e9a80867 HTTP/1.1" status: 200 len: 849 time: 0.1725285 Nov 08 16:03:43.497776 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-60a2cb3d-8e03-4b60-9eee-d702b05d3879 admin admin] 10.222.0.37 "GET /v2.0/routers/60f44016-f872-4b94-8a22-79419b9b20ea HTTP/1.1" status: 200 len: 704 time: 0.1083863 Nov 08 16:03:43.751738 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-de63bc11-cada-48c0-9962-cf54e88bace5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:43.923255 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:44.036556 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_common [None req-de63bc11-cada-48c0-9962-cf54e88bace5 admin admin] Allocated IP 172.20.0.1 (bb51f8ce-3a1d-4770-95c3-615428fadbc5/e932d62b-b59a-44b3-98c4-0ae9e9a80867/4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56) {{(pid=101245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:03:44.186019 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-de63bc11-cada-48c0-9962-cf54e88bace5 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:44.253499 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-de63bc11-cada-48c0-9962-cf54e88bace5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:44.366169 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de63bc11-cada-48c0-9962-cf54e88bace5 admin admin] Network bb51f8ce-3a1d-4770-95c3-615428fadbc5 is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:03:44.372980 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-de63bc11-cada-48c0-9962-cf54e88bace5 admin admin] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:03:44.378477 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de63bc11-cada-48c0-9962-cf54e88bace5 admin admin] Received port after_create {{(pid=101245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:03:44.379468 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-de63bc11-cada-48c0-9962-cf54e88bace5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-2033204'] for router_interface, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:44.401565 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de63bc11-cada-48c0-9962-cf54e88bace5 admin admin] Pushing event updated for resources: {'Port': ['ID=4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:03:44.570667 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-de63bc11-cada-48c0-9962-cf54e88bace5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:44.606065 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-dabb858f-4014-4c96-9ba3-be5c6decc13e None None] Provisioning complete for port 4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:03:44.606641 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-dabb858f-4014-4c96-9ba3-be5c6decc13e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:44.638749 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-dabb858f-4014-4c96-9ba3-be5c6decc13e None None] Port 4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56 cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:03:44.782779 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-de63bc11-cada-48c0-9962-cf54e88bace5 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:44.787276 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-de63bc11-cada-48c0-9962-cf54e88bace5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:44.788288 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-de63bc11-cada-48c0-9962-cf54e88bace5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1599525', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-2033312'] for router_interface, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:44.864760 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de63bc11-cada-48c0-9962-cf54e88bace5 admin admin] Pushing event updated for resources: {'Port': ['ID=4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56,revision_number=2']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:03:44.909474 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de63bc11-cada-48c0-9962-cf54e88bace5 admin admin] Network bb51f8ce-3a1d-4770-95c3-615428fadbc5 is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:03:44.911287 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-de63bc11-cada-48c0-9962-cf54e88bace5 admin admin] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:03:45.067239 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-de63bc11-cada-48c0-9962-cf54e88bace5 admin admin] Router 60f44016-f872-4b94-8a22-79419b9b20ea is scheduled to L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f with binding_index 1 {{(pid=101245) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 08 16:03:45.157048 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-de63bc11-cada-48c0-9962-cf54e88bace5 admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101245) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:03:45.159719 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-76a9c5bf-29ba-4c46-bbd4-8d82a9c03fea None None] Provisioning complete for port 4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:03:45.160141 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-76a9c5bf-29ba-4c46-bbd4-8d82a9c03fea None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:45.162821 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-de63bc11-cada-48c0-9962-cf54e88bace5 admin admin] 10.222.0.37 "PUT /v2.0/routers/60f44016-f872-4b94-8a22-79419b9b20ea/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.6592033 Nov 08 16:03:45.168576 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] Sync routers for ids ['60f44016-f872-4b94-8a22-79419b9b20ea'] in dv-cinder-816187-2-iscsi {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:03:45.183109 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] Routers {'60f44016-f872-4b94-8a22-79419b9b20ea'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:03:45.184301 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:03:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['60f44016-f872-4b94-8a22-79419b9b20ea'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:03:45.198967 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-76a9c5bf-29ba-4c46-bbd4-8d82a9c03fea None None] Port 4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56 cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:03:45.373070 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] Set router 60f44016-f872-4b94-8a22-79419b9b20ea gateway port host: None {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:03:45.794342 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '60f44016-f872-4b94-8a22-79419b9b20ea', 'name': 'router1', 'tenant_id': '7525c72c09024c009f7dd23c611dca3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:03:34Z', 'updated_at': '2021-11-08T16:03:44Z', 'revision_number': 2, 'project_id': '7525c72c09024c009f7dd23c611dca3c', 'gw_port_host': None, '_interfaces': [{'id': '4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56', 'name': '', 'network_id': 'bb51f8ce-3a1d-4770-95c3-615428fadbc5', 'tenant_id': '7525c72c09024c009f7dd23c611dca3c', 'mac_address': 'fa:16:3e:74:dd:bf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '60f44016-f872-4b94-8a22-79419b9b20ea', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'e932d62b-b59a-44b3-98c4-0ae9e9a80867', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:03:43Z', 'updated_at': '2021-11-08T16:03:44Z', 'revision_number': 2, 'project_id': '7525c72c09024c009f7dd23c611dca3c', 'subnets': [{'id': 'e932d62b-b59a-44b3-98c4-0ae9e9a80867', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '806a3da9-d625-4b24-bff0-75bba8e3f2da'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:03:45.844900 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] Checking router: 60f44016-f872-4b94-8a22-79419b9b20ea for host: dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:03:45.845264 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] Updating router 60f44016-f872-4b94-8a22-79419b9b20ea port 4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56 binding host dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 16:03:45.892174 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:46.396682 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] Publish callbacks [] for port, precommit_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:46.402911 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:46.565900 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7ff52a4-4857-4d14-a2d8-94780547a6ba None None] Pushing event updated for resources: {'Port': ['ID=4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56,revision_number=3']} {{(pid=101247) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:03:46.570704 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] Attempting to bind port 4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56 on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:03:46.571097 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] Attempting to bind port 4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56 by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': 'df471971-2b53-43f7-908f-98840800a77e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': 'bb51f8ce-3a1d-4770-95c3-615428fadbc5'}] {{(pid=101247) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:03:46.571550 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] Attempting to bind port 4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56 on network bb51f8ce-3a1d-4770-95c3-615428fadbc5 {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:03:46.579181 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 3, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:03:46.579597 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] Checking segment: {'id': 'df471971-2b53-43f7-908f-98840800a77e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': 'bb51f8ce-3a1d-4770-95c3-615428fadbc5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101247) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:03:46.580067 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:46.580455 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] Bound using segment: {'id': 'df471971-2b53-43f7-908f-98840800a77e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': 'bb51f8ce-3a1d-4770-95c3-615428fadbc5'} {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:03:46.580957 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] Bound port: 4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'df471971-2b53-43f7-908f-98840800a77e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': 'bb51f8ce-3a1d-4770-95c3-615428fadbc5'}}] {{(pid=101247) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:03:46.581342 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:46.590799 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ff52a4-4857-4d14-a2d8-94780547a6ba None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:46.591151 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ff52a4-4857-4d14-a2d8-94780547a6ba None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:46.591487 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ff52a4-4857-4d14-a2d8-94780547a6ba None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:46.591844 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ff52a4-4857-4d14-a2d8-94780547a6ba None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:46.592172 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ff52a4-4857-4d14-a2d8-94780547a6ba None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:46.592495 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ff52a4-4857-4d14-a2d8-94780547a6ba None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:46.592813 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ff52a4-4857-4d14-a2d8-94780547a6ba None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:46.593132 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ff52a4-4857-4d14-a2d8-94780547a6ba None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:46.593455 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ff52a4-4857-4d14-a2d8-94780547a6ba None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:46.593792 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ff52a4-4857-4d14-a2d8-94780547a6ba None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:46.594108 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ff52a4-4857-4d14-a2d8-94780547a6ba None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:46.594418 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ff52a4-4857-4d14-a2d8-94780547a6ba None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ff52a4-4857-4d14-a2d8-94780547a6ba None None] Tracked resource versions report: Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: pushed versions: Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: { 'AddressGroup': {'1.2'}, Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: 'ConntrackHelper': {'1.0'}, Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: 'Log': {'1.0'}, Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: 'Network': {'1.1'}, Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: 'Port': {'1.7'}, Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: 'PortForwarding': {'1.2'}, Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: 'QosPolicy': {'1.10'}, Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: 'SecurityGroup': {'1.5'}, Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: 'SecurityGroupRule': {'1.2'}, Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: 'SubPort': {'1.0'}, Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: 'Subnet': {'1.1'}, Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: 'Trunk': {'1.1'}} Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: consumer versions: Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: { DHCP agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: L3 agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: Metadata agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: Metering agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: Open vSwitch agent@dv-cinder-816187-2-iscsi: { 'AddressGroup': '1.2', Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: 'ConntrackHelper': '1.0', Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: 'Log': '1.0', Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: 'Network': '1.1', Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: 'Port': '1.7', Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: 'PortForwarding': '1.2', Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: 'QosPolicy': '1.10', Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: 'SecurityGroup': '1.5', Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: 'SecurityGroupRule': '1.2', Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: 'SubPort': '1.0', Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: 'Subnet': '1.1', Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: 'Trunk': '1.1'}} Nov 08 16:03:46.595478 dv-cinder-816187-2-iscsi neutron-server[101247]: {{(pid=101247) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 08 16:03:46.626891 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-14200592-4986-40f1-8e20-ec518270dbe4 None None] Provisioning complete for port 4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:03:46.627405 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-14200592-4986-40f1-8e20-ec518270dbe4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:46.658292 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.db [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] For port 4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101247) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:03:46.659644 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-14200592-4986-40f1-8e20-ec518270dbe4 None None] Port 4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56 cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:03:46.679267 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.db [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] For port 4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56,segment=NetworkSegment(df471971-2b53-43f7-908f-98840800a77e),segment_id=df471971-2b53-43f7-908f-98840800a77e)] {{(pid=101247) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:03:46.683256 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:46.731590 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] Routers {'60f44016-f872-4b94-8a22-79419b9b20ea'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:03:46.732209 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:03:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['60f44016-f872-4b94-8a22-79419b9b20ea'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:03:46.810297 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7ff52a4-4857-4d14-a2d8-94780547a6ba None None] Pushing event updated for resources: {'Port': ['ID=4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56,revision_number=4']} {{(pid=101247) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:03:46.839172 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] Set router 60f44016-f872-4b94-8a22-79419b9b20ea gateway port host: None {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:03:46.980275 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6b9316d7-2795-4663-8a1a-0801138e7ffc None None] Provisioning complete for port 4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:03:46.980528 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6b9316d7-2795-4663-8a1a-0801138e7ffc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:47.044453 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '60f44016-f872-4b94-8a22-79419b9b20ea', 'name': 'router1', 'tenant_id': '7525c72c09024c009f7dd23c611dca3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:03:34Z', 'updated_at': '2021-11-08T16:03:44Z', 'revision_number': 2, 'project_id': '7525c72c09024c009f7dd23c611dca3c', 'gw_port_host': None, '_interfaces': [{'id': '4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56', 'name': '', 'network_id': 'bb51f8ce-3a1d-4770-95c3-615428fadbc5', 'tenant_id': '7525c72c09024c009f7dd23c611dca3c', 'mac_address': 'fa:16:3e:74:dd:bf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '60f44016-f872-4b94-8a22-79419b9b20ea', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'e932d62b-b59a-44b3-98c4-0ae9e9a80867', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:03:43Z', 'updated_at': '2021-11-08T16:03:46Z', 'revision_number': 4, 'project_id': '7525c72c09024c009f7dd23c611dca3c', 'subnets': [{'id': 'e932d62b-b59a-44b3-98c4-0ae9e9a80867', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '806a3da9-d625-4b24-bff0-75bba8e3f2da'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:03:47.060357 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6b9316d7-2795-4663-8a1a-0801138e7ffc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:47.075767 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49a7fb85-6c2d-4b7c-8df7-41dd951ac869 None None] The sync data for ids ['60f44016-f872-4b94-8a22-79419b9b20ea'] in dv-cinder-816187-2-iscsi is: [{'id': '60f44016-f872-4b94-8a22-79419b9b20ea', 'name': 'router1', 'tenant_id': '7525c72c09024c009f7dd23c611dca3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:03:34Z', 'updated_at': '2021-11-08T16:03:44Z', 'revision_number': 2, 'project_id': '7525c72c09024c009f7dd23c611dca3c', 'gw_port_host': None, '_interfaces': [{'id': '4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56', 'name': '', 'network_id': 'bb51f8ce-3a1d-4770-95c3-615428fadbc5', 'tenant_id': '7525c72c09024c009f7dd23c611dca3c', 'mac_address': 'fa:16:3e:74:dd:bf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '60f44016-f872-4b94-8a22-79419b9b20ea', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'e932d62b-b59a-44b3-98c4-0ae9e9a80867', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:03:43Z', 'updated_at': '2021-11-08T16:03:46Z', 'revision_number': 4, 'project_id': '7525c72c09024c009f7dd23c611dca3c', 'subnets': [{'id': 'e932d62b-b59a-44b3-98c4-0ae9e9a80867', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '806a3da9-d625-4b24-bff0-75bba8e3f2da'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:03:47.102602 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-6b9316d7-2795-4663-8a1a-0801138e7ffc None None] For port 4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56,segment=NetworkSegment(df471971-2b53-43f7-908f-98840800a77e),segment_id=df471971-2b53-43f7-908f-98840800a77e)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:03:47.109472 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6b9316d7-2795-4663-8a1a-0801138e7ffc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:47.157924 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b9316d7-2795-4663-8a1a-0801138e7ffc None None] Pushing event updated for resources: {'Port': ['ID=4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:03:47.504191 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 57850) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:03:47.612188 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-338b3731-d7be-44b8-a89d-cff370c7547b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:03:47.613587 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-338b3731-d7be-44b8-a89d-cff370c7547b admin admin] 10.222.0.37 "GET /v2.0/networks/68f46265-b42a-49a0-8d57-f9362045cd9b HTTP/1.1" status: 200 len: 842 time: 0.1084483 Nov 08 16:03:47.624544 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-0297d6ef-3384-42e2-8436-313af356435b admin admin] Request body: {'subnet': {'ip_version': 4, 'gateway_ip': '172.27.3.1', 'cidr': '172.27.3.0/24', 'name': 'public-subnet', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'enable_dhcp': False}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:03:47.646321 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0297d6ef-3384-42e2-8436-313af356435b admin admin] Made reservation on behalf of 78c0ac24d03743a587d25bef45bbcf23 for: {'subnet': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:03:47.648537 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0297d6ef-3384-42e2-8436-313af356435b admin admin] Publish callbacks [] for subnet, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:47.919162 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.objects.ports [None req-0297d6ef-3384-42e2-8436-313af356435b admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=101245) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 08 16:03:47.919571 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0297d6ef-3384-42e2-8436-313af356435b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for subnet, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:47.977075 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0297d6ef-3384-42e2-8436-313af356435b admin admin] Pushing event updated for resources: {'Subnet': ['ID=4728e4be-5a19-43c0-89cf-ced2a190645d,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:03:47.982937 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0297d6ef-3384-42e2-8436-313af356435b admin admin] Checking segment: {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:03:47.983269 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0297d6ef-3384-42e2-8436-313af356435b admin admin] Network hostable DHCP agents. Network: 68f46265-b42a-49a0-8d57-f9362045cd9b, hostable agents: ['a7e1e7ee-1ce2-474e-9688-58f0884991a4'], hosted agents: [] {{(pid=101245) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 16:03:47.998936 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0297d6ef-3384-42e2-8436-313af356435b admin admin] Network 68f46265-b42a-49a0-8d57-f9362045cd9b is scheduled to be hosted by DHCP agent a7e1e7ee-1ce2-474e-9688-58f0884991a4 with binding_index 1 {{(pid=101245) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 16:03:48.008242 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-0297d6ef-3384-42e2-8436-313af356435b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816187-2-iscsi, 68f46265-b42a-49a0-8d57-f9362045cd9b) {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:03:48.015713 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53f622f7-cad7-44af-86bb-aaae358875b9 None None] Network 68f46265-b42a-49a0-8d57-f9362045cd9b requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:03:48.017497 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0297d6ef-3384-42e2-8436-313af356435b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:03:48.018099 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0297d6ef-3384-42e2-8436-313af356435b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for subnet, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:48.035887 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-0297d6ef-3384-42e2-8436-313af356435b admin admin] 10.222.0.37 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4148154 Nov 08 16:03:48.155452 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-518220e9-e0e5-4ec1-ad73-8a9216cdb6eb None None] Network 68f46265-b42a-49a0-8d57-f9362045cd9b requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:03:50.479033 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 57858) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:03:50.679207 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-624a1dc5-afb1-4950-92b0-1410aadd2e97 admin admin] 10.222.0.37 "GET /v2.0/routers/60f44016-f872-4b94-8a22-79419b9b20ea HTTP/1.1" status: 200 len: 710 time: 0.1988666 Nov 08 16:03:50.769579 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9154cb15-a813-4246-af77-12cdfbdb79dc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:03:50.771244 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-9154cb15-a813-4246-af77-12cdfbdb79dc admin admin] 10.222.0.37 "GET /v2.0/networks/68f46265-b42a-49a0-8d57-f9362045cd9b HTTP/1.1" status: 200 len: 886 time: 0.0855849 Nov 08 16:03:50.781589 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-e6866913-67fd-4d5a-bba1-f2d89e67dc10 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:03:51.030562 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e6866913-67fd-4d5a-bba1-f2d89e67dc10 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:51.258308 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e6866913-67fd-4d5a-bba1-f2d89e67dc10 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:51.329431 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e6866913-67fd-4d5a-bba1-f2d89e67dc10 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:51.444637 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_common [None req-e6866913-67fd-4d5a-bba1-f2d89e67dc10 admin admin] Allocated IP 172.27.3.141 (68f46265-b42a-49a0-8d57-f9362045cd9b/4728e4be-5a19-43c0-89cf-ced2a190645d/af84da02-54d7-419f-bf7d-1e39e8db87e1) {{(pid=101245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:03:51.546511 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e6866913-67fd-4d5a-bba1-f2d89e67dc10 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:51.578276 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e6866913-67fd-4d5a-bba1-f2d89e67dc10 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:51.617704 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6866913-67fd-4d5a-bba1-f2d89e67dc10 admin admin] Network 68f46265-b42a-49a0-8d57-f9362045cd9b is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:03:51.620794 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-e6866913-67fd-4d5a-bba1-f2d89e67dc10 admin admin] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:03:51.624875 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6866913-67fd-4d5a-bba1-f2d89e67dc10 admin admin] Received port after_create {{(pid=101245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:03:51.627602 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6866913-67fd-4d5a-bba1-f2d89e67dc10 admin admin] Pushing event updated for resources: {'Port': ['ID=af84da02-54d7-419f-bf7d-1e39e8db87e1,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:03:51.865334 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e6866913-67fd-4d5a-bba1-f2d89e67dc10 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:52.139930 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e6866913-67fd-4d5a-bba1-f2d89e67dc10 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-2032154', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-2034831', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-12891'] for router, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:52.143233 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e6866913-67fd-4d5a-bba1-f2d89e67dc10 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-2032353', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-2032147', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-2032360', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-2034820'] for router, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:52.247269 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e6866913-67fd-4d5a-bba1-f2d89e67dc10 admin admin] Router 60f44016-f872-4b94-8a22-79419b9b20ea has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101245) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:03:52.355814 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e6866913-67fd-4d5a-bba1-f2d89e67dc10 admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101245) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:03:52.359973 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e6866913-67fd-4d5a-bba1-f2d89e67dc10 admin admin] Publish callbacks [] for router, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:52.361140 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-e6866913-67fd-4d5a-bba1-f2d89e67dc10 admin admin] 10.222.0.37 "PUT /v2.0/routers/60f44016-f872-4b94-8a22-79419b9b20ea HTTP/1.1" status: 200 len: 890 time: 1.5834272 Nov 08 16:03:53.714820 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:03:53.764938 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:03:53.765378 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:53.993559 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] Sync routers for ids ['60f44016-f872-4b94-8a22-79419b9b20ea'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:03:54.005612 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] Routers {'60f44016-f872-4b94-8a22-79419b9b20ea'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:03:54.006299 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:03:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['60f44016-f872-4b94-8a22-79419b9b20ea'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:03:54.209854 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] Set router 60f44016-f872-4b94-8a22-79419b9b20ea gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:03:54.598861 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 5 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:03:54.663036 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '60f44016-f872-4b94-8a22-79419b9b20ea', 'name': 'router1', 'tenant_id': '7525c72c09024c009f7dd23c611dca3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.141'}], 'enable_snat': True}, 'gw_port_id': 'af84da02-54d7-419f-bf7d-1e39e8db87e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:03:34Z', 'updated_at': '2021-11-08T16:03:51Z', 'revision_number': 4, 'project_id': '7525c72c09024c009f7dd23c611dca3c', 'gw_port': {'id': 'af84da02-54d7-419f-bf7d-1e39e8db87e1', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:3f:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '60f44016-f872-4b94-8a22-79419b9b20ea', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:03:51Z', 'updated_at': '2021-11-08T16:03:51Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56', 'name': '', 'network_id': 'bb51f8ce-3a1d-4770-95c3-615428fadbc5', 'tenant_id': '7525c72c09024c009f7dd23c611dca3c', 'mac_address': 'fa:16:3e:74:dd:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '60f44016-f872-4b94-8a22-79419b9b20ea', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'e932d62b-b59a-44b3-98c4-0ae9e9a80867', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:03:43Z', 'updated_at': '2021-11-08T16:03:47Z', 'revision_number': 5, 'project_id': '7525c72c09024c009f7dd23c611dca3c', 'subnets': [{'id': 'e932d62b-b59a-44b3-98c4-0ae9e9a80867', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '806a3da9-d625-4b24-bff0-75bba8e3f2da'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:03:54.716341 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] Checking router: 60f44016-f872-4b94-8a22-79419b9b20ea for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:03:54.717011 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] Updating router 60f44016-f872-4b94-8a22-79419b9b20ea port af84da02-54d7-419f-bf7d-1e39e8db87e1 binding host dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 16:03:54.762948 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:54.878743 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 57870) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:03:54.990431 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-1e5038dd-94d5-4fe1-a8a7-52d0b9a2270b admin admin] 10.222.0.37 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.1106448 Nov 08 16:03:55.081165 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] Publish callbacks [] for port, precommit_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:55.087249 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:55.145862 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ece64f9d-7517-4db2-8520-878dc0cc9bc7 None None] Pushing event updated for resources: {'Port': ['ID=af84da02-54d7-419f-bf7d-1e39e8db87e1,revision_number=2']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:03:55.148318 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] Attempting to bind port af84da02-54d7-419f-bf7d-1e39e8db87e1 on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:03:55.148690 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] Attempting to bind port af84da02-54d7-419f-bf7d-1e39e8db87e1 by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:03:55.149051 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] Attempting to bind port af84da02-54d7-419f-bf7d-1e39e8db87e1 on network 68f46265-b42a-49a0-8d57-f9362045cd9b {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:03:55.154910 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 3, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:03:55.155310 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] Checking segment: {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:03:55.155668 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:55.156055 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] Bound using segment: {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:03:55.156521 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] Bound port: af84da02-54d7-419f-bf7d-1e39e8db87e1, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:03:55.156919 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:55.208582 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] For port af84da02-54d7-419f-bf7d-1e39e8db87e1, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:03:55.211604 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] For port af84da02-54d7-419f-bf7d-1e39e8db87e1, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=af84da02-54d7-419f-bf7d-1e39e8db87e1,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:03:55.216079 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:55.268069 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] Routers {'60f44016-f872-4b94-8a22-79419b9b20ea'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:03:55.269182 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:03:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['60f44016-f872-4b94-8a22-79419b9b20ea'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:03:55.312745 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ece64f9d-7517-4db2-8520-878dc0cc9bc7 None None] Pushing event updated for resources: {'Port': ['ID=af84da02-54d7-419f-bf7d-1e39e8db87e1,revision_number=3']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:03:55.382147 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] Set router 60f44016-f872-4b94-8a22-79419b9b20ea gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:03:55.593969 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '60f44016-f872-4b94-8a22-79419b9b20ea', 'name': 'router1', 'tenant_id': '7525c72c09024c009f7dd23c611dca3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.141'}], 'enable_snat': True}, 'gw_port_id': 'af84da02-54d7-419f-bf7d-1e39e8db87e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:03:34Z', 'updated_at': '2021-11-08T16:03:51Z', 'revision_number': 4, 'project_id': '7525c72c09024c009f7dd23c611dca3c', 'gw_port': {'id': 'af84da02-54d7-419f-bf7d-1e39e8db87e1', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:3f:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '60f44016-f872-4b94-8a22-79419b9b20ea', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:03:51Z', 'updated_at': '2021-11-08T16:03:55Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56', 'name': '', 'network_id': 'bb51f8ce-3a1d-4770-95c3-615428fadbc5', 'tenant_id': '7525c72c09024c009f7dd23c611dca3c', 'mac_address': 'fa:16:3e:74:dd:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '60f44016-f872-4b94-8a22-79419b9b20ea', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'e932d62b-b59a-44b3-98c4-0ae9e9a80867', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:03:43Z', 'updated_at': '2021-11-08T16:03:47Z', 'revision_number': 5, 'project_id': '7525c72c09024c009f7dd23c611dca3c', 'subnets': [{'id': 'e932d62b-b59a-44b3-98c4-0ae9e9a80867', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '806a3da9-d625-4b24-bff0-75bba8e3f2da'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:03:55.619270 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f315afd8-4ddc-43d5-b1ad-d7a80500bb0b None None] The sync data for ids ['60f44016-f872-4b94-8a22-79419b9b20ea'] in dv-cinder-816187-2-iscsi is: [{'id': '60f44016-f872-4b94-8a22-79419b9b20ea', 'name': 'router1', 'tenant_id': '7525c72c09024c009f7dd23c611dca3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.141'}], 'enable_snat': True}, 'gw_port_id': 'af84da02-54d7-419f-bf7d-1e39e8db87e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:03:34Z', 'updated_at': '2021-11-08T16:03:51Z', 'revision_number': 4, 'project_id': '7525c72c09024c009f7dd23c611dca3c', 'gw_port': {'id': 'af84da02-54d7-419f-bf7d-1e39e8db87e1', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:3f:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '60f44016-f872-4b94-8a22-79419b9b20ea', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:03:51Z', 'updated_at': '2021-11-08T16:03:55Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56', 'name': '', 'network_id': 'bb51f8ce-3a1d-4770-95c3-615428fadbc5', 'tenant_id': '7525c72c09024c009f7dd23c611dca3c', 'mac_address': 'fa:16:3e:74:dd:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '60f44016-f872-4b94-8a22-79419b9b20ea', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'e932d62b-b59a-44b3-98c4-0ae9e9a80867', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:03:43Z', 'updated_at': '2021-11-08T16:03:47Z', 'revision_number': 5, 'project_id': '7525c72c09024c009f7dd23c611dca3c', 'subnets': [{'id': 'e932d62b-b59a-44b3-98c4-0ae9e9a80867', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '806a3da9-d625-4b24-bff0-75bba8e3f2da'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:03:57.734130 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device af84da02-54d7-419f-bf7d-1e39e8db87e1 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:03:57.789188 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port af84da02-54d7-419f-bf7d-1e39e8db87e1 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:03:57.789577 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:57.864770 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:57.885349 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] For port af84da02-54d7-419f-bf7d-1e39e8db87e1, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=af84da02-54d7-419f-bf7d-1e39e8db87e1,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:03:57.889241 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:03:57.936813 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Pushing event updated for resources: {'Port': ['ID=af84da02-54d7-419f-bf7d-1e39e8db87e1,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:03:59.728871 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device af84da02-54d7-419f-bf7d-1e39e8db87e1 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:03:59.816863 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port af84da02-54d7-419f-bf7d-1e39e8db87e1 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:03:59.817583 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:04:08.089070 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-4915ac54-958d-4ba3-b5d7-8ab647d91390 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:04:10.555762 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7406d055-5f80-49e6-afe2-3787481bd496 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:04:11.464681 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:04:13.214462 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:04:13.926458 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:04:31.597844 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 5 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:04:38.086047 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-e6b40a43-c670-4e1e-a4d2-38ef660900e8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:04:40.550825 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-3cfab167-9b44-4163-8872-1343c8717199 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:04:41.461024 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:04:43.194363 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:04:43.936411 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:05:08.081062 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-1bd42d7e-e158-4858-a132-3fe7d25d1cc4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:05:08.597011 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 5 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:05:10.552729 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-3f9aa7a3-c68b-4f51-b117-bc8cf5c9619a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:05:11.464993 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:05:13.194842 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:05:13.927589 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:05:34.398577 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 58432) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:05:34.458192 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.pecan_wsgi.hooks.translation [None req-61a7b40f-2c02-4e64-b433-fb1f5007dd4f admin admin] GET failed (client error): The resource could not be found. Nov 08 16:05:34.459474 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-61a7b40f-2c02-4e64-b433-fb1f5007dd4f admin admin] 10.222.0.37 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0599494 Nov 08 16:05:34.611872 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-921b2535-6422-443f-be7b-b9befe60242a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:05:34.613224 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-921b2535-6422-443f-be7b-b9befe60242a admin admin] 10.222.0.37 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1492357 Nov 08 16:05:36.865172 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 58442) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:05:36.957809 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eeae40fa-efab-464b-868c-c5967b0637c7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:05:36.959128 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-eeae40fa-efab-464b-868c-c5967b0637c7 admin admin] 10.222.0.37 "GET /v2.0/subnets/e932d62b-b59a-44b3-98c4-0ae9e9a80867 HTTP/1.1" status: 200 len: 849 time: 0.0929244 Nov 08 16:05:36.968871 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-41321a84-7155-4c87-91c4-ef3f899ff03a admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:05:37.047726 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-41321a84-7155-4c87-91c4-ef3f899ff03a admin admin] Publish callbacks [] for subnet, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:05:37.184182 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-41321a84-7155-4c87-91c4-ef3f899ff03a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8792877257611'] for subnet, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:05:37.214063 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-41321a84-7155-4c87-91c4-ef3f899ff03a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:05:37.214866 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-41321a84-7155-4c87-91c4-ef3f899ff03a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for subnet, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:05:37.221595 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-41321a84-7155-4c87-91c4-ef3f899ff03a admin admin] 10.222.0.37 "PUT /v2.0/subnets/e932d62b-b59a-44b3-98c4-0ae9e9a80867 HTTP/1.1" status: 200 len: 868 time: 0.2505956 Nov 08 16:05:37.221850 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-183120be-1acc-4f42-93ed-2d957effffc1 None None] Network bb51f8ce-3a1d-4770-95c3-615428fadbc5 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:05:37.237466 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41321a84-7155-4c87-91c4-ef3f899ff03a admin admin] Pushing event updated for resources: {'Subnet': ['ID=e932d62b-b59a-44b3-98c4-0ae9e9a80867,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:05:37.245179 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41321a84-7155-4c87-91c4-ef3f899ff03a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:05:37.245559 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41321a84-7155-4c87-91c4-ef3f899ff03a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:05:37.246054 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41321a84-7155-4c87-91c4-ef3f899ff03a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:05:37.246416 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41321a84-7155-4c87-91c4-ef3f899ff03a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:05:37.246588 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41321a84-7155-4c87-91c4-ef3f899ff03a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:05:37.246962 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41321a84-7155-4c87-91c4-ef3f899ff03a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:05:37.247235 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41321a84-7155-4c87-91c4-ef3f899ff03a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:05:37.247622 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41321a84-7155-4c87-91c4-ef3f899ff03a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:05:37.247902 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41321a84-7155-4c87-91c4-ef3f899ff03a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:05:37.248216 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41321a84-7155-4c87-91c4-ef3f899ff03a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:05:37.248601 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41321a84-7155-4c87-91c4-ef3f899ff03a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:05:37.248852 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41321a84-7155-4c87-91c4-ef3f899ff03a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:05:37.636548 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-1376e43c-7178-4813-8441-0530cbd9856c None None] Provisioning complete for port 40106071-6de2-4f87-9e6d-63ab9e0eba11 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:05:37.636910 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-1376e43c-7178-4813-8441-0530cbd9856c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:05:37.720396 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-1376e43c-7178-4813-8441-0530cbd9856c None None] Provisioning complete for port 4a8ad72c-56d3-4a52-9ef3-5d9ff2d01e56 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:05:37.720762 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-1376e43c-7178-4813-8441-0530cbd9856c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:05:38.082895 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-84464b67-69d3-4aa3-8a17-d70a954555bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:05:39.488813 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 58450) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:05:39.684457 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78ad5948-7a89-4708-a697-d8abd2112952 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:05:39.684825 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78ad5948-7a89-4708-a697-d8abd2112952 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:05:39.686384 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-78ad5948-7a89-4708-a697-d8abd2112952 admin admin] 10.222.0.37 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1966066 Nov 08 16:05:40.552701 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-87bd1d25-d4bd-4bfa-aacb-a76f0fd3ae32 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:05:41.466196 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:05:41.957434 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 58458) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:05:42.084355 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78e088d2-a38d-4f5e-9f0c-0e2e6cc2c950 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:05:42.084463 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78e088d2-a38d-4f5e-9f0c-0e2e6cc2c950 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:05:42.086001 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-78e088d2-a38d-4f5e-9f0c-0e2e6cc2c950 admin admin] 10.222.0.37 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1275754 Nov 08 16:05:43.197370 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:05:43.930116 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:05:44.358341 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 58466) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:05:44.545771 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d066286f-3040-4c7e-a804-81c64b9c3fab admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:05:44.547718 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-d066286f-3040-4c7e-a804-81c64b9c3fab admin admin] 10.222.0.37 "GET /v2.0/networks/68f46265-b42a-49a0-8d57-f9362045cd9b HTTP/1.1" status: 200 len: 886 time: 0.1879122 Nov 08 16:05:45.595624 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 5 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:05:46.813530 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 58476) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:05:46.955614 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1b33d76-b881-4abe-8d17-f9b956dec87b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:05:46.956948 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-f1b33d76-b881-4abe-8d17-f9b956dec87b admin admin] 10.222.0.37 "GET /v2.0/networks/bb51f8ce-3a1d-4770-95c3-615428fadbc5 HTTP/1.1" status: 200 len: 869 time: 0.1424515 Nov 08 16:05:49.235718 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 58484) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:05:49.356871 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8a36c77-c9a1-4d62-8039-d99ab49a2e5a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:05:49.357240 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8a36c77-c9a1-4d62-8039-d99ab49a2e5a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:05:49.358748 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-e8a36c77-c9a1-4d62-8039-d99ab49a2e5a admin admin] 10.222.0.37 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1220913 Nov 08 16:05:51.617337 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 58492) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:05:51.705220 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-863f2cb6-dd04-420c-ab10-aa2012f78828 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:05:51.705655 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-863f2cb6-dd04-420c-ab10-aa2012f78828 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:05:51.707142 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-863f2cb6-dd04-420c-ab10-aa2012f78828 admin admin] 10.222.0.37 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.0887659 Nov 08 16:05:53.953997 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 58500) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:05:54.039812 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0abd4c22-895d-4040-b3bd-7e465c0f2da0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:05:54.041135 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-0abd4c22-895d-4040-b3bd-7e465c0f2da0 admin admin] 10.222.0.37 "GET /v2.0/subnets/4728e4be-5a19-43c0-89cf-ced2a190645d HTTP/1.1" status: 200 len: 816 time: 0.0861957 Nov 08 16:05:56.308366 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 58508) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:05:56.397814 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7fc172f6-6c99-4655-b32f-2679aaf37fcf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:05:56.399113 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-7fc172f6-6c99-4655-b32f-2679aaf37fcf admin admin] 10.222.0.37 "GET /v2.0/subnets/e932d62b-b59a-44b3-98c4-0ae9e9a80867 HTTP/1.1" status: 200 len: 868 time: 0.0898125 Nov 08 16:06:08.085378 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7f82f030-f360-4d4f-be07-3596ba96f6b5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:10.554374 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-3ee9ee20-341e-4239-9de2-811fa545f43d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:11.469322 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:13.200313 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:13.931411 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:20.498320 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 58562) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:06:20.544959 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [None req-430217cb-2ee9-4012-b7d3-d2bfa99bf821 admin admin] http://10.222.0.37:9696/v2.0/extensions returned with HTTP 200 {{(pid=101245) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 16:06:20.545978 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-430217cb-2ee9-4012-b7d3-d2bfa99bf821 admin admin] 10.222.0.37 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0466461 Nov 08 16:06:22.594535 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 5 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:06:22.895804 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 58570) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:06:22.954588 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.pecan_wsgi.hooks.translation [None req-7b93aa4b-9ad6-47e8-88f7-48ab25b5fa5a admin admin] GET failed (client error): The resource could not be found. Nov 08 16:06:22.955856 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-7b93aa4b-9ad6-47e8-88f7-48ab25b5fa5a admin admin] 10.222.0.37 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0591416 Nov 08 16:06:23.040232 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-733d617f-55ab-4972-beab-4296fb8a9683 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:06:23.041660 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-733d617f-55ab-4972-beab-4296fb8a9683 admin admin] 10.222.0.37 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.0812044 Nov 08 16:06:25.340656 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 58578) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:06:25.387141 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-c1a52209-1903-43af-bf7f-d6c4e7e87cdf admin admin] Request body: {'network': {'admin_state_up': True, 'name': 'shared', 'shared': True}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:06:25.407202 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c1a52209-1903-43af-bf7f-d6c4e7e87cdf admin admin] Made reservation on behalf of 78c0ac24d03743a587d25bef45bbcf23 for: {'network': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:06:25.409549 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c1a52209-1903-43af-bf7f-d6c4e7e87cdf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for network, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:25.530687 dv-cinder-816187-2-iscsi neutron-server[101245]: WARNING neutron.services.revisions.revision_plugin [None req-c1a52209-1903-43af-bf7f-d6c4e7e87cdf admin admin] Could not find related network for resource to bump revision. Nov 08 16:06:25.544210 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c1a52209-1903-43af-bf7f-d6c4e7e87cdf admin admin] vlan segment allocate from pool success with {'vlan_id': 199, 'physical_network': 'physnet1'} {{(pid=101245) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 16:06:25.554042 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c1a52209-1903-43af-bf7f-d6c4e7e87cdf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:25.554364 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.db.segments_db [None req-c1a52209-1903-43af-bf7f-d6c4e7e87cdf admin admin] Added segment 51e384ca-3902-4a51-92bb-10c10d81cc09 of type vlan for network a2294cb7-764a-4e2f-b2f9-20c7c9294f57 Nov 08 16:06:25.591337 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c1a52209-1903-43af-bf7f-d6c4e7e87cdf admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792876766172'] for network, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:25.614237 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c1a52209-1903-43af-bf7f-d6c4e7e87cdf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for network, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:25.615164 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1a52209-1903-43af-bf7f-d6c4e7e87cdf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:06:25.615745 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c1a52209-1903-43af-bf7f-d6c4e7e87cdf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:25.666964 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-c1a52209-1903-43af-bf7f-d6c4e7e87cdf admin admin] 10.222.0.37 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.3253069 Nov 08 16:06:25.677647 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1a52209-1903-43af-bf7f-d6c4e7e87cdf admin admin] Pushing event updated for resources: {'Network': ['ID=a2294cb7-764a-4e2f-b2f9-20c7c9294f57,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:06:25.690097 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Network a2294cb7-764a-4e2f-b2f9-20c7c9294f57 details requested by agent ovs-agent-dv-cinder-816187-2-iscsi with host dv-cinder-816187-2-iscsi {{(pid=101246) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 16:06:27.980650 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 58586) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:06:28.039897 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.pecan_wsgi.hooks.translation [None req-40d5bfc5-7a09-429a-8f39-272ee4ed1e73 admin admin] GET failed (client error): The resource could not be found. Nov 08 16:06:28.041168 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-40d5bfc5-7a09-429a-8f39-272ee4ed1e73 admin admin] 10.222.0.37 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0595753 Nov 08 16:06:28.107566 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb6c450e-f0ff-4ee1-ae07-2cbe41537619 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:06:28.109571 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-fb6c450e-f0ff-4ee1-ae07-2cbe41537619 admin admin] 10.222.0.37 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0638435 Nov 08 16:06:28.119818 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-3f948560-c44e-4396-ae75-8a01e01a1043 admin admin] Request body: {'subnet': {'cidr': '192.168.233.0/24', 'name': 'shared-subnet', 'description': 'shared-subnet', 'network_id': 'a2294cb7-764a-4e2f-b2f9-20c7c9294f57', 'ip_version': 4}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:06:28.139531 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3f948560-c44e-4396-ae75-8a01e01a1043 admin admin] Made reservation on behalf of 78c0ac24d03743a587d25bef45bbcf23 for: {'subnet': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:06:28.142043 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3f948560-c44e-4396-ae75-8a01e01a1043 admin admin] Publish callbacks [] for subnet, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:28.298706 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3f948560-c44e-4396-ae75-8a01e01a1043 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for subnet, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:28.354066 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f948560-c44e-4396-ae75-8a01e01a1043 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4b4a67eb-b83b-4b1a-85f3-128683340457,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:06:28.358176 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f948560-c44e-4396-ae75-8a01e01a1043 admin admin] Checking segment: {'id': '51e384ca-3902-4a51-92bb-10c10d81cc09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': 'a2294cb7-764a-4e2f-b2f9-20c7c9294f57'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:06:28.358548 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3f948560-c44e-4396-ae75-8a01e01a1043 admin admin] Network hostable DHCP agents. Network: a2294cb7-764a-4e2f-b2f9-20c7c9294f57, hostable agents: ['a7e1e7ee-1ce2-474e-9688-58f0884991a4'], hosted agents: [] {{(pid=101245) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 16:06:28.373980 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3f948560-c44e-4396-ae75-8a01e01a1043 admin admin] Network a2294cb7-764a-4e2f-b2f9-20c7c9294f57 is scheduled to be hosted by DHCP agent a7e1e7ee-1ce2-474e-9688-58f0884991a4 with binding_index 1 {{(pid=101245) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 16:06:28.381911 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-3f948560-c44e-4396-ae75-8a01e01a1043 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816187-2-iscsi, a2294cb7-764a-4e2f-b2f9-20c7c9294f57) {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:06:28.385612 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f948560-c44e-4396-ae75-8a01e01a1043 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:06:28.386223 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3f948560-c44e-4396-ae75-8a01e01a1043 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for subnet, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:28.391653 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-769d45bf-c26c-4921-8ef9-b719fa49a7f9 None None] Network a2294cb7-764a-4e2f-b2f9-20c7c9294f57 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:06:28.401185 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-3f948560-c44e-4396-ae75-8a01e01a1043 admin admin] 10.222.0.37 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.2847905 Nov 08 16:06:28.540451 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp66bc375f-c06b-591f-b467-1ee6ff0ebcc7-a2294cb7-764a-4e2f-b2f9-20c7c9294f57', 'network_id': 'a2294cb7-764a-4e2f-b2f9-20c7c9294f57', 'tenant_id': '78c0ac24d03743a587d25bef45bbcf23', 'fixed_ips': [{'subnet_id': '4b4a67eb-b83b-4b1a-85f3-128683340457'}]}} from dv-cinder-816187-2-iscsi. {{(pid=101246) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 08 16:06:28.541417 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:28.677282 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.db_base_plugin_common [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Allocated IP 192.168.233.2 (a2294cb7-764a-4e2f-b2f9-20c7c9294f57/4b4a67eb-b83b-4b1a-85f3-128683340457/23b876aa-bf5e-4c7a-b1cc-e617427d3649) {{(pid=101246) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:06:28.911521 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Publish callbacks [] for port, precommit_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:28.918162 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:28.955845 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Network a2294cb7-764a-4e2f-b2f9-20c7c9294f57 is already hosted by enough agents. {{(pid=101246) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:06:28.960524 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.scheduler.base_scheduler [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Resources bound (agent type, host, resource id): {{(pid=101246) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:06:28.963074 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Received port after_create {{(pid=101246) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:06:28.974734 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Pushing event updated for resources: {'Port': ['ID=23b876aa-bf5e-4c7a-b1cc-e617427d3649,revision_number=1']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:06:28.996244 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:06:28.996865 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:06:28.997205 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:06:28.997539 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:06:28.997894 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:06:28.998224 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:06:28.998545 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:06:28.998867 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:06:28.999238 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:06:28.999578 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:06:28.999917 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:06:29.000293 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:06:29.035304 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Attempting to bind port 23b876aa-bf5e-4c7a-b1cc-e617427d3649 on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:06:29.035671 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Attempting to bind port 23b876aa-bf5e-4c7a-b1cc-e617427d3649 by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': '51e384ca-3902-4a51-92bb-10c10d81cc09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': 'a2294cb7-764a-4e2f-b2f9-20c7c9294f57'}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:06:29.036025 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Attempting to bind port 23b876aa-bf5e-4c7a-b1cc-e617427d3649 on network a2294cb7-764a-4e2f-b2f9-20c7c9294f57 {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:06:29.040888 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 6, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:06:29.041258 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Checking segment: {'id': '51e384ca-3902-4a51-92bb-10c10d81cc09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': 'a2294cb7-764a-4e2f-b2f9-20c7c9294f57'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:06:29.041649 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:29.042064 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Bound using segment: {'id': '51e384ca-3902-4a51-92bb-10c10d81cc09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': 'a2294cb7-764a-4e2f-b2f9-20c7c9294f57'} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:06:29.042518 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Bound port: 23b876aa-bf5e-4c7a-b1cc-e617427d3649, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '51e384ca-3902-4a51-92bb-10c10d81cc09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': 'a2294cb7-764a-4e2f-b2f9-20c7c9294f57'}}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:06:29.042912 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:29.103635 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] For port 23b876aa-bf5e-4c7a-b1cc-e617427d3649, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:06:29.109560 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] For port 23b876aa-bf5e-4c7a-b1cc-e617427d3649, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=23b876aa-bf5e-4c7a-b1cc-e617427d3649,segment=NetworkSegment(51e384ca-3902-4a51-92bb-10c10d81cc09),segment_id=51e384ca-3902-4a51-92bb-10c10d81cc09)] {{(pid=101246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:06:29.112763 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:29.168897 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87453f3d-7fa0-45c9-9028-3bcf148c0c8b None None] Pushing event updated for resources: {'Port': ['ID=23b876aa-bf5e-4c7a-b1cc-e617427d3649,revision_number=2']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:06:29.826792 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 23b876aa-bf5e-4c7a-b1cc-e617427d3649 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:06:29.890356 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 23b876aa-bf5e-4c7a-b1cc-e617427d3649 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:06:29.890731 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:29.975112 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:29.985635 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ee682e34-7631-461a-a0c9-cf1cff60cae0 None None] Network a2294cb7-764a-4e2f-b2f9-20c7c9294f57 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:06:30.072081 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] For port 23b876aa-bf5e-4c7a-b1cc-e617427d3649, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=23b876aa-bf5e-4c7a-b1cc-e617427d3649,segment=NetworkSegment(51e384ca-3902-4a51-92bb-10c10d81cc09),segment_id=51e384ca-3902-4a51-92bb-10c10d81cc09)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:06:30.077080 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:30.118055 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-2400b16b-c367-4148-8df8-c155357c3265 None None] Provisioning complete for port 23b876aa-bf5e-4c7a-b1cc-e617427d3649 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:06:30.118420 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-2400b16b-c367-4148-8df8-c155357c3265 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:30.181791 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Pushing event updated for resources: {'Port': ['ID=23b876aa-bf5e-4c7a-b1cc-e617427d3649,revision_number=3']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:06:30.493410 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-0e301c3d-29cd-40f8-9cf1-d8eda7a5a261 None None] Provisioning complete for port 23b876aa-bf5e-4c7a-b1cc-e617427d3649 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:06:30.493817 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-0e301c3d-29cd-40f8-9cf1-d8eda7a5a261 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:31.792238 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 23b876aa-bf5e-4c7a-b1cc-e617427d3649 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:06:31.838501 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 23b876aa-bf5e-4c7a-b1cc-e617427d3649 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:06:31.838866 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:38.087695 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-e5946e65-9bba-463c-ba4b-d01a73d70b9e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:40.558181 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-00f527df-4d43-4936-99ec-71cae2268a18 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:41.471910 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:43.203241 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:43.933029 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:06:59.593381 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 5 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:07:08.093641 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-8eb0ada3-a930-464a-b00b-685a1489930b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:07:10.560079 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-e41fdd1e-bad7-4923-bedf-87df98595d00 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:07:11.474337 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:07:13.207134 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:07:13.934838 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:07:36.592127 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 5 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:07:38.086554 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-053aaf9f-1584-454f-919b-842d8e444d4f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:07:40.563688 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-bf72527e-e020-44d4-aa08-bccc5b940f3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:07:41.479090 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:07:43.211989 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:07:43.936893 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:07:44.267556 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 58632) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:07:44.273330 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [None req-ca9b0168-23bf-486e-a6c9-1869d893508b tempest-verify_tempest_config-825370562 tempest-verify_tempest_config-825370562-project] http://10.222.0.37:9696/v2.0/extensions returned with HTTP 200 {{(pid=101245) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 16:07:44.274314 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-ca9b0168-23bf-486e-a6c9-1869d893508b tempest-verify_tempest_config-825370562 tempest-verify_tempest_config-825370562-project] 10.222.0.37 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0057943 Nov 08 16:07:44.555781 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 58650) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:07:44.659816 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-fc88fc50-fe25-47f7-9753-cb00ff05290f admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:07:44.729435 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-fc88fc50-fe25-47f7-9753-cb00ff05290f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:07:44.733527 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-fc88fc50-fe25-47f7-9753-cb00ff05290f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:07:44.777065 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-fc88fc50-fe25-47f7-9753-cb00ff05290f admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=f1d97ab216d04f35ae7160f4391cfadd&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2202556 Nov 08 16:07:44.780058 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc88fc50-fe25-47f7-9753-cb00ff05290f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d9f1a2e9-8cc3-42fa-b7e7-27e531a05810,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:07:44.780446 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 58654) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:07:44.785944 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc88fc50-fe25-47f7-9753-cb00ff05290f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:07:44.786299 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc88fc50-fe25-47f7-9753-cb00ff05290f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:07:44.786632 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc88fc50-fe25-47f7-9753-cb00ff05290f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:07:44.786958 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc88fc50-fe25-47f7-9753-cb00ff05290f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:07:44.787274 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc88fc50-fe25-47f7-9753-cb00ff05290f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:07:44.787604 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc88fc50-fe25-47f7-9753-cb00ff05290f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:07:44.787923 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc88fc50-fe25-47f7-9753-cb00ff05290f admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:07:44.788251 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc88fc50-fe25-47f7-9753-cb00ff05290f admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:07:44.788584 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc88fc50-fe25-47f7-9753-cb00ff05290f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:07:44.788896 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc88fc50-fe25-47f7-9753-cb00ff05290f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:07:44.789205 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc88fc50-fe25-47f7-9753-cb00ff05290f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:07:44.789508 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc88fc50-fe25-47f7-9753-cb00ff05290f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:07:44.838419 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-50686341-4858-48f6-b869-c8155cfde8f6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:07:44.860647 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-50686341-4858-48f6-b869-c8155cfde8f6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:07:44.967495 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-50686341-4858-48f6-b869-c8155cfde8f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:07:44.970047 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-50686341-4858-48f6-b869-c8155cfde8f6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:07:44.971161 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-50686341-4858-48f6-b869-c8155cfde8f6 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/d9f1a2e9-8cc3-42fa-b7e7-27e531a05810 HTTP/1.1" status: 204 len: 168 time: 0.1892598 Nov 08 16:07:44.979014 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50686341-4858-48f6-b869-c8155cfde8f6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d9f1a2e9-8cc3-42fa-b7e7-27e531a05810,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:07:44.986110 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50686341-4858-48f6-b869-c8155cfde8f6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:07:44.986393 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50686341-4858-48f6-b869-c8155cfde8f6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:07:44.986717 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50686341-4858-48f6-b869-c8155cfde8f6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:07:44.987034 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50686341-4858-48f6-b869-c8155cfde8f6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:07:44.987350 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50686341-4858-48f6-b869-c8155cfde8f6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:07:44.987690 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50686341-4858-48f6-b869-c8155cfde8f6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:07:44.988008 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50686341-4858-48f6-b869-c8155cfde8f6 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:07:44.988320 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50686341-4858-48f6-b869-c8155cfde8f6 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:07:44.988631 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50686341-4858-48f6-b869-c8155cfde8f6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:07:44.988940 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50686341-4858-48f6-b869-c8155cfde8f6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:07:44.989250 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50686341-4858-48f6-b869-c8155cfde8f6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:07:44.989568 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50686341-4858-48f6-b869-c8155cfde8f6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:08:08.087474 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-319285d5-65ca-4a58-ab42-5d7599786085 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:08:10.564878 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-18a48212-bc4f-4b32-83d5-289f58e8f83d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:08:11.480676 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:08:13.211133 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:08:13.590131 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 5 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:08:13.937430 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:08:38.098140 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-5d67dc96-252f-428d-a129-8d9151c88d68 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:08:40.565356 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-3aefc285-f3ab-4069-8464-0bcbe3b23555 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:08:41.483112 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:08:43.213602 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:08:43.937640 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:08:50.587844 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 5 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:09:08.089646 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-619abaab-4e89-49c5-9272-968b46e6be16 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:09:10.565878 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7503cb4c-2cb3-4c6c-a296-ccd467156998 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:09:11.490749 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:09:13.215619 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:09:13.938918 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:09:15.660486 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-2034664'] for agent, after_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:09:27.586529 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:09:30.089808 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 58728) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:09:30.194006 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-f0490339-0dd6-4ea2-ae8e-c9386e0cf01e admin admin] 10.222.0.37 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.1031055 Nov 08 16:09:32.489253 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 58738) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:09:32.542724 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-081c70bd-81d1-40be-8489-dc6873d3bdbb admin admin] 10.222.0.37 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.0523386 Nov 08 16:09:38.092707 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6961b034-9142-49ef-8f2a-69d17cb1cb6e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:09:40.567448 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-a03d6dd3-47f6-46eb-9863-7f9da05936c6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:09:41.493075 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:09:43.218547 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:09:43.939062 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:09:45.613164 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:10:04.584981 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:10:08.093283 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-50dd7e50-f06e-491a-93f0-32da7443e1ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:10:10.568509 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-4a2e3e25-5ce9-4500-8c6f-202a37ac53a8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:10:11.493831 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:10:13.221831 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:10:13.939682 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:10:15.623293 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:10:38.094514 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-f6c73d1a-6869-4e64-b2a6-749bd25ba502 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:10:40.570078 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-b021e315-bb3c-4e94-a06c-6d42e16cccc1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:10:41.497203 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:10:41.583720 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:10:43.224347 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:10:43.940895 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:10:45.622090 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:00.868855 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 58892) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:01.057223 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1204269590-network', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:01.080325 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Made reservation on behalf of 10a4252a63bf480d93d2e9da15bb8efd for: {'network': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:11:01.082879 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for network, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:01.091801 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:01.169896 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:01.174276 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:01.196112 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] vlan segment allocate from pool success with {'vlan_id': 188, 'physical_network': 'physnet1'} {{(pid=101244) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 16:11:01.219792 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7bd95f0a-8c65-4087-8c2d-b857133d9bf4,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:01.230035 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:01.230376 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.db.segments_db [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Added segment 13aab495-f4c4-414c-b50c-fd22b4e0ef0b of type vlan for network e0e08679-82fe-47eb-90b6-49a1713fdaca Nov 08 16:11:01.241804 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:01.242962 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:01.243275 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:01.243703 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:01.244103 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:01.244490 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:01.244818 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:01.245155 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:01.245490 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:01.245829 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:01.246146 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:01.246456 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Tracked resource versions report: Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: pushed versions: Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: { 'AddressGroup': {'1.2'}, Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: 'ConntrackHelper': {'1.0'}, Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: 'Log': {'1.0'}, Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: 'Network': {'1.1'}, Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: 'Port': {'1.7'}, Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: 'PortForwarding': {'1.2'}, Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: 'QosPolicy': {'1.10'}, Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: 'SecurityGroup': {'1.5'}, Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: 'SecurityGroupRule': {'1.2'}, Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: 'SubPort': {'1.0'}, Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: 'Subnet': {'1.1'}, Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: 'Trunk': {'1.1'}} Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: consumer versions: Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: { DHCP agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: HyperV agent@hv-cinder-81618: {}, Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: L3 agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: Metadata agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: Metering agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: Open vSwitch agent@dv-cinder-816187-2-iscsi: { 'AddressGroup': '1.2', Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: 'ConntrackHelper': '1.0', Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: 'Log': '1.0', Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: 'Network': '1.1', Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: 'Port': '1.7', Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: 'PortForwarding': '1.2', Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: 'QosPolicy': '1.10', Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: 'SecurityGroup': '1.5', Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: 'SecurityGroupRule': '1.2', Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: 'SubPort': '1.0', Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: 'Subnet': '1.1', Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: 'Trunk': '1.1'}} Nov 08 16:11:01.247476 dv-cinder-816187-2-iscsi neutron-server[101244]: {{(pid=101244) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 08 16:11:01.285988 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792876766172'] for network, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:01.311682 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 58928) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:01.322588 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for network, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:01.324073 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:01.325367 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:01.394335 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] 10.222.0.37 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 0.5270727 Nov 08 16:11:01.395879 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19df657c-0402-49d1-bc51-8df96807d528 admin admin] Pushing event updated for resources: {'Network': ['ID=e0e08679-82fe-47eb-90b6-49a1713fdaca,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:01.397481 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 58940) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:01.403008 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] Request body: {'subnet': {'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1204269590-subnet', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:01.408404 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Network e0e08679-82fe-47eb-90b6-49a1713fdaca details requested by agent ovs-agent-dv-cinder-816187-2-iscsi with host dv-cinder-816187-2-iscsi {{(pid=101246) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 16:11:01.435916 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] Made reservation on behalf of 10a4252a63bf480d93d2e9da15bb8efd for: {'subnet': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:11:01.438499 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] Publish callbacks [] for subnet, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:01.500053 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 58944) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:01.611219 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for subnet, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:01.666496 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] Pushing event updated for resources: {'Subnet': ['ID=fc52ff8b-1692-487b-a0de-f6290e65d880,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:01.675001 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:01.675403 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:01.675698 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:01.676022 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:01.676346 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:01.676690 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:01.676997 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:01.677338 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:01.677653 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:01.677987 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:01.678294 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:01.678776 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] Tracked resource versions report: Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: pushed versions: Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: { 'AddressGroup': {'1.2'}, Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: 'ConntrackHelper': {'1.0'}, Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: 'Log': {'1.0'}, Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: 'Network': {'1.1'}, Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: 'Port': {'1.7'}, Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: 'PortForwarding': {'1.2'}, Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: 'QosPolicy': {'1.10'}, Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: 'SecurityGroup': {'1.5'}, Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: 'SecurityGroupRule': {'1.2'}, Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: 'SubPort': {'1.0'}, Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: 'Subnet': {'1.1'}, Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: 'Trunk': {'1.1'}} Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: consumer versions: Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: { DHCP agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: HyperV agent@hv-cinder-81618: {}, Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: L3 agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: Metadata agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: Metering agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: Open vSwitch agent@dv-cinder-816187-2-iscsi: { 'AddressGroup': '1.2', Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: 'ConntrackHelper': '1.0', Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: 'Log': '1.0', Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: 'Network': '1.1', Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: 'Port': '1.7', Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: 'PortForwarding': '1.2', Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: 'QosPolicy': '1.10', Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: 'SecurityGroup': '1.5', Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: 'SecurityGroupRule': '1.2', Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: 'SubPort': '1.0', Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: 'Subnet': '1.1', Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: 'Trunk': '1.1'}} Nov 08 16:11:01.680701 dv-cinder-816187-2-iscsi neutron-server[101245]: {{(pid=101245) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 08 16:11:01.689518 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] Checking segment: {'id': '13aab495-f4c4-414c-b50c-fd22b4e0ef0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 188, 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:11:01.689898 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] Network hostable DHCP agents. Network: e0e08679-82fe-47eb-90b6-49a1713fdaca, hostable agents: ['a7e1e7ee-1ce2-474e-9688-58f0884991a4'], hosted agents: [] {{(pid=101245) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 16:11:01.719770 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-f8a29de8-a26d-4ac7-bed9-3d5d490cea26 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-272347721-network', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:01.724029 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] Network e0e08679-82fe-47eb-90b6-49a1713fdaca is scheduled to be hosted by DHCP agent a7e1e7ee-1ce2-474e-9688-58f0884991a4 with binding_index 1 {{(pid=101245) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 16:11:01.743876 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f8a29de8-a26d-4ac7-bed9-3d5d490cea26 admin admin] Made reservation on behalf of f6e779f0506643d08d984c2971d5a71c for: {'network': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:11:01.746622 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f8a29de8-a26d-4ac7-bed9-3d5d490cea26 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for network, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:01.755961 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f8a29de8-a26d-4ac7-bed9-3d5d490cea26 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:01.768898 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816187-2-iscsi, e0e08679-82fe-47eb-90b6-49a1713fdaca) {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:11:01.773146 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:01.773953 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for subnet, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:01.780521 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea046f03-8fbd-45a1-a222-9cfbc74dbce6 None None] Network e0e08679-82fe-47eb-90b6-49a1713fdaca requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:11:01.803208 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 58954) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:01.838097 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 58960) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:01.843777 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-8f730d81-260d-497a-9430-870b7ddb6ded admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1204269590-router', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:01.847950 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-3c05a030-266c-41ae-8bec-f78782f701ef admin admin] 10.222.0.37 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 0.4492881 Nov 08 16:11:01.881969 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8f730d81-260d-497a-9430-870b7ddb6ded admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-2034701', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-12912'] for router, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:01.887433 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8f730d81-260d-497a-9430-870b7ddb6ded admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-2034873', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-2032180', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-2080911', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-12873'] for router, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:01.902810 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f8a29de8-a26d-4ac7-bed9-3d5d490cea26 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:01.909015 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f8a29de8-a26d-4ac7-bed9-3d5d490cea26 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:01.936346 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f8a29de8-a26d-4ac7-bed9-3d5d490cea26 admin admin] vlan segment allocate from pool success with {'vlan_id': 191, 'physical_network': 'physnet1'} {{(pid=101245) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 16:11:01.951522 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f8a29de8-a26d-4ac7-bed9-3d5d490cea26 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:01.952132 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.db.segments_db [None req-f8a29de8-a26d-4ac7-bed9-3d5d490cea26 admin admin] Added segment 7651dfae-d245-4d32-b379-dc243d043404 of type vlan for network 75fa9c3e-7bfe-490a-9118-221394c29646 Nov 08 16:11:01.998463 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 58968) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:02.001255 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp66bc375f-c06b-591f-b467-1ee6ff0ebcc7-e0e08679-82fe-47eb-90b6-49a1713fdaca', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'fixed_ips': [{'subnet_id': 'fc52ff8b-1692-487b-a0de-f6290e65d880'}]}} from dv-cinder-816187-2-iscsi. {{(pid=101246) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 08 16:11:02.002494 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.005094 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8a29de8-a26d-4ac7-bed9-3d5d490cea26 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0b450963-0861-4ed2-bd08-0b6e00ecb590,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:02.017485 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f8a29de8-a26d-4ac7-bed9-3d5d490cea26 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792876766172'] for network, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.069644 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f8a29de8-a26d-4ac7-bed9-3d5d490cea26 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for network, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.070876 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8a29de8-a26d-4ac7-bed9-3d5d490cea26 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:02.071610 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f8a29de8-a26d-4ac7-bed9-3d5d490cea26 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.072516 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8f730d81-260d-497a-9430-870b7ddb6ded admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.079999 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-0ea4e6ad-05a4-40d1-8e42-b74ea6f96928 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1345492682-network', 'tenant_id': '549e9715f7424ff5b3b252f354adafe9'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:02.095880 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-27fb786e-846a-4d7b-b993-9f70493f2957 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-593854580-network', 'tenant_id': '4818358a827143eb9ace58a26713cdf0'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:02.159500 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8a29de8-a26d-4ac7-bed9-3d5d490cea26 admin admin] Pushing event updated for resources: {'Network': ['ID=75fa9c3e-7bfe-490a-9118-221394c29646,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:02.177112 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-b4359d98-553a-48f5-9f86-de5eb752bba4 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-532634732-network', 'tenant_id': '170b9e4079834c589534d39e70e1dba3'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:02.178744 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Network 75fa9c3e-7bfe-490a-9118-221394c29646 details requested by agent ovs-agent-dv-cinder-816187-2-iscsi with host dv-cinder-816187-2-iscsi {{(pid=101246) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 16:11:02.292394 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.db_base_plugin_common [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Allocated IP 172.20.0.2 (e0e08679-82fe-47eb-90b6-49a1713fdaca/fc52ff8b-1692-487b-a0de-f6290e65d880/2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7) {{(pid=101246) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:11:02.296968 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-f8a29de8-a26d-4ac7-bed9-3d5d490cea26 admin admin] 10.222.0.37 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.9848704 Nov 08 16:11:02.298703 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b4359d98-553a-48f5-9f86-de5eb752bba4 admin admin] Made reservation on behalf of 170b9e4079834c589534d39e70e1dba3 for: {'network': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:11:02.302652 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b4359d98-553a-48f5-9f86-de5eb752bba4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for network, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.304514 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 58980) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:02.325559 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0ea4e6ad-05a4-40d1-8e42-b74ea6f96928 admin admin] Made reservation on behalf of 549e9715f7424ff5b3b252f354adafe9 for: {'network': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:11:02.328071 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0ea4e6ad-05a4-40d1-8e42-b74ea6f96928 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for network, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.340494 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-1ae9cda0-c5d6-4e45-bab6-4582b91b20e7 admin admin] Request body: {'subnet': {'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-272347721-subnet', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:02.351362 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b4359d98-553a-48f5-9f86-de5eb752bba4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.378315 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8f730d81-260d-497a-9430-870b7ddb6ded admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.384976 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0ea4e6ad-05a4-40d1-8e42-b74ea6f96928 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.404394 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-27fb786e-846a-4d7b-b993-9f70493f2957 admin admin] Made reservation on behalf of 4818358a827143eb9ace58a26713cdf0 for: {'network': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:11:02.407139 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-27fb786e-846a-4d7b-b993-9f70493f2957 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for network, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.450022 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b4359d98-553a-48f5-9f86-de5eb752bba4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.451969 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1ae9cda0-c5d6-4e45-bab6-4582b91b20e7 admin admin] Made reservation on behalf of f6e779f0506643d08d984c2971d5a71c for: {'subnet': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:11:02.455144 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1ae9cda0-c5d6-4e45-bab6-4582b91b20e7 admin admin] Publish callbacks [] for subnet, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.462044 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-27fb786e-846a-4d7b-b993-9f70493f2957 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.487784 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Publish callbacks [] for port, precommit_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.496045 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.543098 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Network e0e08679-82fe-47eb-90b6-49a1713fdaca is already hosted by enough agents. {{(pid=101246) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:11:02.546533 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.scheduler.base_scheduler [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Resources bound (agent type, host, resource id): {{(pid=101246) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:11:02.555684 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Received port after_create {{(pid=101246) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:11:02.592446 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Pushing event updated for resources: {'Port': ['ID=2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7,revision_number=1']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:02.601372 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:02.601957 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:02.602400 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:02.602834 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:02.603266 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:02.604184 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:02.604612 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:02.605069 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:02.605510 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:02.605925 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:02.606337 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:02.606721 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Tracked resource versions report: Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: pushed versions: Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: { 'AddressGroup': {'1.2'}, Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: 'ConntrackHelper': {'1.0'}, Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: 'Log': {'1.0'}, Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: 'Network': {'1.1'}, Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: 'Port': {'1.7'}, Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: 'PortForwarding': {'1.2'}, Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: 'QosPolicy': {'1.10'}, Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: 'SecurityGroup': {'1.5'}, Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: 'SecurityGroupRule': {'1.2'}, Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: 'SubPort': {'1.0'}, Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: 'Subnet': {'1.1'}, Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: 'Trunk': {'1.1'}} Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: consumer versions: Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: { DHCP agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: HyperV agent@hv-cinder-81618: {}, Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: L3 agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: Metadata agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: Metering agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: Open vSwitch agent@dv-cinder-816187-2-iscsi: { 'AddressGroup': '1.2', Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: 'ConntrackHelper': '1.0', Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: 'Log': '1.0', Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: 'Network': '1.1', Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: 'Port': '1.7', Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: 'PortForwarding': '1.2', Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: 'QosPolicy': '1.10', Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: 'SecurityGroup': '1.5', Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: 'SecurityGroupRule': '1.2', Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: 'SubPort': '1.0', Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: 'Subnet': '1.1', Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: 'Trunk': '1.1'}} Nov 08 16:11:02.607860 dv-cinder-816187-2-iscsi neutron-server[101246]: {{(pid=101246) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 08 16:11:02.682255 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Attempting to bind port 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7 on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:11:02.682815 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Attempting to bind port 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7 by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': '13aab495-f4c4-414c-b50c-fd22b4e0ef0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 188, 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca'}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:11:02.683572 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Attempting to bind port 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7 on network e0e08679-82fe-47eb-90b6-49a1713fdaca {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:11:02.691250 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 10, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:11:02.691881 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Checking segment: {'id': '13aab495-f4c4-414c-b50c-fd22b4e0ef0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 188, 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:11:02.692347 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.692907 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Bound using segment: {'id': '13aab495-f4c4-414c-b50c-fd22b4e0ef0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 188, 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca'} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:11:02.693039 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0ea4e6ad-05a4-40d1-8e42-b74ea6f96928 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.695209 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Bound port: 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '13aab495-f4c4-414c-b50c-fd22b4e0ef0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 188, 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca'}}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:11:02.695209 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.704994 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0ea4e6ad-05a4-40d1-8e42-b74ea6f96928 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.748345 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b4359d98-553a-48f5-9f86-de5eb752bba4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.760363 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b4359d98-553a-48f5-9f86-de5eb752bba4 admin admin] vlan segment allocate from pool success with {'vlan_id': 163, 'physical_network': 'physnet1'} {{(pid=101245) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 16:11:02.769691 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b4359d98-553a-48f5-9f86-de5eb752bba4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.770356 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.db.segments_db [None req-b4359d98-553a-48f5-9f86-de5eb752bba4 admin admin] Added segment 297c0462-3903-48e7-a4ef-95b52eec7b18 of type vlan for network 8d351af8-ed05-48f5-939b-8cf227b5c91c Nov 08 16:11:02.781189 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] For port 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:11:02.785514 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] For port 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:11:02.792200 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.796283 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ea4e6ad-05a4-40d1-8e42-b74ea6f96928 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f4e825d4-82e2-4eb6-a4d3-6b2103528712,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:02.822772 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1ae9cda0-c5d6-4e45-bab6-4582b91b20e7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for subnet, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.834542 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0ea4e6ad-05a4-40d1-8e42-b74ea6f96928 admin admin] vlan segment allocate from pool success with {'vlan_id': 173, 'physical_network': 'physnet1'} {{(pid=101244) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 16:11:02.860975 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-27fb786e-846a-4d7b-b993-9f70493f2957 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.862484 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0ea4e6ad-05a4-40d1-8e42-b74ea6f96928 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.862955 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.db.segments_db [None req-0ea4e6ad-05a4-40d1-8e42-b74ea6f96928 admin admin] Added segment fab7ad78-c438-48e7-8fdb-80ff50b8600c of type vlan for network f70ee550-62a6-48db-bca5-a0b964bbcce9 Nov 08 16:11:02.876575 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-27fb786e-846a-4d7b-b993-9f70493f2957 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.879087 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efbd8d66-b58c-4682-84f2-db94d20a1f8d None None] Pushing event updated for resources: {'Port': ['ID=2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7,revision_number=2']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:02.904503 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-27fb786e-846a-4d7b-b993-9f70493f2957 admin admin] vlan segment allocate from pool success with {'vlan_id': 164, 'physical_network': 'physnet1'} {{(pid=101244) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 16:11:02.922972 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4359d98-553a-48f5-9f86-de5eb752bba4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=038cdbd7-8cb8-45e1-a69d-0ade6842560f,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:02.968036 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-27fb786e-846a-4d7b-b993-9f70493f2957 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.969185 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b4359d98-553a-48f5-9f86-de5eb752bba4 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792876766172'] for network, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:02.969788 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.db.segments_db [None req-27fb786e-846a-4d7b-b993-9f70493f2957 admin admin] Added segment e14404ea-b710-490a-b578-a605dfc73350 of type vlan for network 2d5b5768-37f3-49a1-b451-2803f6f97429 Nov 08 16:11:03.030373 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ae9cda0-c5d6-4e45-bab6-4582b91b20e7 admin admin] Checking segment: {'id': '7651dfae-d245-4d32-b379-dc243d043404', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:11:03.030725 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ae9cda0-c5d6-4e45-bab6-4582b91b20e7 admin admin] Network hostable DHCP agents. Network: 75fa9c3e-7bfe-490a-9118-221394c29646, hostable agents: ['a7e1e7ee-1ce2-474e-9688-58f0884991a4'], hosted agents: [] {{(pid=101245) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 16:11:03.034844 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ae9cda0-c5d6-4e45-bab6-4582b91b20e7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8b248e51-4c70-4980-9452-c6b625bf96dd,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:03.058085 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b4359d98-553a-48f5-9f86-de5eb752bba4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for network, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:03.059428 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b4359d98-553a-48f5-9f86-de5eb752bba4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:03.060274 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b4359d98-553a-48f5-9f86-de5eb752bba4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:03.062970 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27fb786e-846a-4d7b-b993-9f70493f2957 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b296658b-8eb6-4f30-aeff-34c29a116b94,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:03.151686 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ae9cda0-c5d6-4e45-bab6-4582b91b20e7 admin admin] Network 75fa9c3e-7bfe-490a-9118-221394c29646 is scheduled to be hosted by DHCP agent a7e1e7ee-1ce2-474e-9688-58f0884991a4 with binding_index 1 {{(pid=101245) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 16:11:03.164159 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4359d98-553a-48f5-9f86-de5eb752bba4 admin admin] Pushing event updated for resources: {'Network': ['ID=8d351af8-ed05-48f5-939b-8cf227b5c91c,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:03.164777 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0ea4e6ad-05a4-40d1-8e42-b74ea6f96928 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792876766172'] for network, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:03.174961 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Network 8d351af8-ed05-48f5-939b-8cf227b5c91c details requested by agent ovs-agent-dv-cinder-816187-2-iscsi with host dv-cinder-816187-2-iscsi {{(pid=101246) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 16:11:03.189889 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-b4359d98-553a-48f5-9f86-de5eb752bba4 admin admin] 10.222.0.37 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 1.1727605 Nov 08 16:11:03.191198 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 59012) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:03.191771 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-1ae9cda0-c5d6-4e45-bab6-4582b91b20e7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816187-2-iscsi, 75fa9c3e-7bfe-490a-9118-221394c29646) {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:11:03.199275 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ae9cda0-c5d6-4e45-bab6-4582b91b20e7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:03.207213 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1ae9cda0-c5d6-4e45-bab6-4582b91b20e7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for subnet, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:03.244237 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-417e96b0-a0fe-4c8c-97af-a8bab77ba69c admin admin] Request body: {'subnet': {'network_id': '8d351af8-ed05-48f5-939b-8cf227b5c91c', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-532634732-subnet', 'tenant_id': '170b9e4079834c589534d39e70e1dba3', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:03.263782 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-1ae9cda0-c5d6-4e45-bab6-4582b91b20e7 admin admin] 10.222.0.37 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.9501598 Nov 08 16:11:03.308377 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 59022) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:03.308377 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-2552fc4d-c9c5-4f5a-8b19-d6061200e9a6 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-272347721-router', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:03.332533 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-14702594-cfcf-4f86-9b18-74748044d5f2 None None] Network 75fa9c3e-7bfe-490a-9118-221394c29646 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:11:03.337342 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-417e96b0-a0fe-4c8c-97af-a8bab77ba69c admin admin] Made reservation on behalf of 170b9e4079834c589534d39e70e1dba3 for: {'subnet': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:11:03.341946 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-417e96b0-a0fe-4c8c-97af-a8bab77ba69c admin admin] Publish callbacks [] for subnet, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:03.376220 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.db.resource_extend [None req-0ea4e6ad-05a4-40d1-8e42-b74ea6f96928 admin admin] It took 0.14 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 08 16:11:03.477259 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-2552fc4d-c9c5-4f5a-8b19-d6061200e9a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-2034701', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-12912'] for router, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:03.484370 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-2552fc4d-c9c5-4f5a-8b19-d6061200e9a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-2034873', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-2032180', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-2080911', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-12873'] for router, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:03.569479 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-27fb786e-846a-4d7b-b993-9f70493f2957 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792876766172'] for network, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:03.585781 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8f730d81-260d-497a-9430-870b7ddb6ded admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:03.587196 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-2552fc4d-c9c5-4f5a-8b19-d6061200e9a6 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:03.629512 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8f730d81-260d-497a-9430-870b7ddb6ded admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:03.651174 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0ea4e6ad-05a4-40d1-8e42-b74ea6f96928 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for network, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:03.652044 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ea4e6ad-05a4-40d1-8e42-b74ea6f96928 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:03.652658 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0ea4e6ad-05a4-40d1-8e42-b74ea6f96928 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:03.706337 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-728be5c3-c478-4186-82dd-5da8c835cc84 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp66bc375f-c06b-591f-b467-1ee6ff0ebcc7-75fa9c3e-7bfe-490a-9118-221394c29646', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'fixed_ips': [{'subnet_id': '8b248e51-4c70-4980-9452-c6b625bf96dd'}]}} from dv-cinder-816187-2-iscsi. {{(pid=101246) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 08 16:11:03.707224 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-728be5c3-c478-4186-82dd-5da8c835cc84 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:03.808635 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-27fb786e-846a-4d7b-b993-9f70493f2957 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for network, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:03.809615 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-27fb786e-846a-4d7b-b993-9f70493f2957 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:03.810432 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-27fb786e-846a-4d7b-b993-9f70493f2957 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:03.829160 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-417e96b0-a0fe-4c8c-97af-a8bab77ba69c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for subnet, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:03.872986 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-0ea4e6ad-05a4-40d1-8e42-b74ea6f96928 admin admin] 10.222.0.37 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 2.3712602 Nov 08 16:11:03.882642 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59050) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:03.904026 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-b32a54f2-1b9c-4e5e-8e94-fd6b3de82302 admin admin] Request body: {'subnet': {'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1345492682-subnet', 'tenant_id': '549e9715f7424ff5b3b252f354adafe9', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:03.959595 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-27fb786e-846a-4d7b-b993-9f70493f2957 admin admin] 10.222.0.37 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 2.1549232 Nov 08 16:11:03.973682 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59060) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:04.004953 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-3c6653d2-4d9b-4d19-8b04-6bbcadef11fc admin admin] Request body: {'subnet': {'network_id': '2d5b5768-37f3-49a1-b451-2803f6f97429', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-593854580-subnet', 'tenant_id': '4818358a827143eb9ace58a26713cdf0', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:04.044684 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ea4e6ad-05a4-40d1-8e42-b74ea6f96928 admin admin] Pushing event updated for resources: {'Network': ['ID=f70ee550-62a6-48db-bca5-a0b964bbcce9,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:04.083458 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Network f70ee550-62a6-48db-bca5-a0b964bbcce9 details requested by agent ovs-agent-dv-cinder-816187-2-iscsi with host dv-cinder-816187-2-iscsi {{(pid=101246) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 16:11:04.155162 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-2552fc4d-c9c5-4f5a-8b19-d6061200e9a6 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:04.191736 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-417e96b0-a0fe-4c8c-97af-a8bab77ba69c admin admin] Pushing event updated for resources: {'Subnet': ['ID=caeb6ff4-65b7-4e61-97f1-b93b8755570e,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:04.207337 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b32a54f2-1b9c-4e5e-8e94-fd6b3de82302 admin admin] Made reservation on behalf of 549e9715f7424ff5b3b252f354adafe9 for: {'subnet': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:11:04.214413 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b32a54f2-1b9c-4e5e-8e94-fd6b3de82302 admin admin] Publish callbacks [] for subnet, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:04.230402 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3c6653d2-4d9b-4d19-8b04-6bbcadef11fc admin admin] Made reservation on behalf of 4818358a827143eb9ace58a26713cdf0 for: {'subnet': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:11:04.232785 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-3c6653d2-4d9b-4d19-8b04-6bbcadef11fc admin admin] Publish callbacks [] for subnet, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:04.258761 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:11:04.318713 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-417e96b0-a0fe-4c8c-97af-a8bab77ba69c admin admin] Checking segment: {'id': '297c0462-3903-48e7-a4ef-95b52eec7b18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '8d351af8-ed05-48f5-939b-8cf227b5c91c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:11:04.319966 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-417e96b0-a0fe-4c8c-97af-a8bab77ba69c admin admin] Network hostable DHCP agents. Network: 8d351af8-ed05-48f5-939b-8cf227b5c91c, hostable agents: ['a7e1e7ee-1ce2-474e-9688-58f0884991a4'], hosted agents: [] {{(pid=101245) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 16:11:04.375646 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-417e96b0-a0fe-4c8c-97af-a8bab77ba69c admin admin] Network 8d351af8-ed05-48f5-939b-8cf227b5c91c is scheduled to be hosted by DHCP agent a7e1e7ee-1ce2-474e-9688-58f0884991a4 with binding_index 1 {{(pid=101245) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 16:11:04.398725 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-417e96b0-a0fe-4c8c-97af-a8bab77ba69c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816187-2-iscsi, 8d351af8-ed05-48f5-939b-8cf227b5c91c) {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:11:04.408969 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-417e96b0-a0fe-4c8c-97af-a8bab77ba69c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:04.410009 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-417e96b0-a0fe-4c8c-97af-a8bab77ba69c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for subnet, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:04.492985 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-417e96b0-a0fe-4c8c-97af-a8bab77ba69c admin admin] 10.222.0.37 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.2893023 Nov 08 16:11:04.529814 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [None req-8f730d81-260d-497a-9430-870b7ddb6ded admin admin] Allocated IP 172.27.3.118 (68f46265-b42a-49a0-8d57-f9362045cd9b/4728e4be-5a19-43c0-89cf-ced2a190645d/d3af559a-99c6-40a2-85f2-bab38b3887e1) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:11:04.568667 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27fb786e-846a-4d7b-b993-9f70493f2957 admin admin] Pushing event updated for resources: {'Network': ['ID=2d5b5768-37f3-49a1-b451-2803f6f97429,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:04.597755 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 59100) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:04.774072 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-644103fe-80cf-4953-b499-58122740478f None None] Network 8d351af8-ed05-48f5-939b-8cf227b5c91c requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:11:04.924669 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Network 2d5b5768-37f3-49a1-b451-2803f6f97429 details requested by agent ovs-agent-dv-cinder-816187-2-iscsi with host dv-cinder-816187-2-iscsi {{(pid=101246) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 16:11:04.926488 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6e882ced-dec7-4046-b74d-5b4d7d58675c None None] Network e0e08679-82fe-47eb-90b6-49a1713fdaca requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:11:04.942576 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-2552fc4d-c9c5-4f5a-8b19-d6061200e9a6 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:05.018353 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-2552fc4d-c9c5-4f5a-8b19-d6061200e9a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:05.027350 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-3c6653d2-4d9b-4d19-8b04-6bbcadef11fc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for subnet, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:05.144074 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c6653d2-4d9b-4d19-8b04-6bbcadef11fc admin admin] Pushing event updated for resources: {'Subnet': ['ID=6936707c-bd3f-4cd8-9462-a4af0ea16ed8,revision_number=0']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:05.166212 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.db_base_plugin_common [None req-728be5c3-c478-4186-82dd-5da8c835cc84 None None] Allocated IP 172.20.0.2 (75fa9c3e-7bfe-490a-9118-221394c29646/8b248e51-4c70-4980-9452-c6b625bf96dd/71c92ac9-ccca-40b1-acfe-69b3046505a6) {{(pid=101246) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:11:05.203089 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe4e09d6-60c7-4dac-afd4-a2ff47ef6964 None None] Network 8d351af8-ed05-48f5-939b-8cf227b5c91c requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:11:05.203745 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8f730d81-260d-497a-9430-870b7ddb6ded admin admin] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:05.213880 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ce51f38b-84c0-4767-b7c2-cffc7ec671e8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:05.261739 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c6653d2-4d9b-4d19-8b04-6bbcadef11fc admin admin] Checking segment: {'id': 'e14404ea-b710-490a-b578-a605dfc73350', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '2d5b5768-37f3-49a1-b451-2803f6f97429'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:11:05.261739 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c6653d2-4d9b-4d19-8b04-6bbcadef11fc admin admin] Network hostable DHCP agents. Network: 2d5b5768-37f3-49a1-b451-2803f6f97429, hostable agents: ['a7e1e7ee-1ce2-474e-9688-58f0884991a4'], hosted agents: [] {{(pid=101244) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 16:11:05.333703 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b32a54f2-1b9c-4e5e-8e94-fd6b3de82302 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for subnet, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:05.377932 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c6653d2-4d9b-4d19-8b04-6bbcadef11fc admin admin] Network 2d5b5768-37f3-49a1-b451-2803f6f97429 is scheduled to be hosted by DHCP agent a7e1e7ee-1ce2-474e-9688-58f0884991a4 with binding_index 1 {{(pid=101244) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 16:11:05.399090 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8f730d81-260d-497a-9430-870b7ddb6ded admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:05.417152 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-3c6653d2-4d9b-4d19-8b04-6bbcadef11fc admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816187-2-iscsi, 2d5b5768-37f3-49a1-b451-2803f6f97429) {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:11:05.437441 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c6653d2-4d9b-4d19-8b04-6bbcadef11fc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:05.439715 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-3c6653d2-4d9b-4d19-8b04-6bbcadef11fc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for subnet, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:05.465439 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b32a54f2-1b9c-4e5e-8e94-fd6b3de82302 admin admin] Pushing event updated for resources: {'Subnet': ['ID=cd23e532-b366-42a0-82e4-ec7326cf3b48,revision_number=0']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:05.472354 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59166) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:05.480647 dv-cinder-816187-2-iscsi neutron-server[101244]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 08 16:11:05.485177 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8f730d81-260d-497a-9430-870b7ddb6ded admin admin] Network 68f46265-b42a-49a0-8d57-f9362045cd9b is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:11:05.526864 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58774811-12be-4953-9811-606e575cc4eb None None] Network 2d5b5768-37f3-49a1-b451-2803f6f97429 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:11:05.569591 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-8f730d81-260d-497a-9430-870b7ddb6ded admin admin] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:11:05.614702 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 59180) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:05.625817 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f730d81-260d-497a-9430-870b7ddb6ded admin admin] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:11:05.639293 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-0329d5a8-b398-4eab-bbb0-9b3e155e0fe2 None None] Provisioning complete for port 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:05.639795 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-0329d5a8-b398-4eab-bbb0-9b3e155e0fe2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:05.642263 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-3c6653d2-4d9b-4d19-8b04-6bbcadef11fc admin admin] 10.222.0.37 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 855 time: 1.6461792 Nov 08 16:11:05.663701 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 59186) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:05.674062 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-c51e64a6-111a-4551-9fee-ea5ccf6906d4 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-593854580-router', 'tenant_id': '4818358a827143eb9ace58a26713cdf0', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:05.692966 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ce51f38b-84c0-4767-b7c2-cffc7ec671e8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:05.721187 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c51e64a6-111a-4551-9fee-ea5ccf6906d4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-2034701', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-12912'] for router, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:05.722938 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c51e64a6-111a-4551-9fee-ea5ccf6906d4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-2034873', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-2032180', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-2080911', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-12873'] for router, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:05.763339 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:05.763783 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:05.779598 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c51e64a6-111a-4551-9fee-ea5ccf6906d4 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:05.783365 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_common [None req-2552fc4d-c9c5-4f5a-8b19-d6061200e9a6 admin admin] Allocated IP 172.27.3.128 (68f46265-b42a-49a0-8d57-f9362045cd9b/4728e4be-5a19-43c0-89cf-ced2a190645d/570b0fd6-c5f9-427e-a59a-28c493e0cd78) {{(pid=101245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:11:05.786573 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ce51f38b-84c0-4767-b7c2-cffc7ec671e8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:05.825662 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-ce51f38b-84c0-4767-b7c2-cffc7ec671e8 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=960caf34e2b84bf88e45b68f0d89acf8&name=default HTTP/1.1" status: 200 len: 2992 time: 1.2208686 Nov 08 16:11:05.834284 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b32a54f2-1b9c-4e5e-8e94-fd6b3de82302 admin admin] Checking segment: {'id': 'fab7ad78-c438-48e7-8fdb-80ff50b8600c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:11:05.835128 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b32a54f2-1b9c-4e5e-8e94-fd6b3de82302 admin admin] Network hostable DHCP agents. Network: f70ee550-62a6-48db-bca5-a0b964bbcce9, hostable agents: ['a7e1e7ee-1ce2-474e-9688-58f0884991a4'], hosted agents: [] {{(pid=101244) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 16:11:05.900742 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59198) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:05.911115 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-b27ef10b-5252-42f4-b963-2d0b63db5c2a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:05.912577 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-b27ef10b-5252-42f4-b963-2d0b63db5c2a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/networks?id=8d351af8-ed05-48f5-939b-8cf227b5c91c HTTP/1.1" status: 200 len: 811 time: 0.4332373 Nov 08 16:11:05.920101 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f730d81-260d-497a-9430-870b7ddb6ded admin admin] Pushing event updated for resources: {'Port': ['ID=d3af559a-99c6-40a2-85f2-bab38b3887e1,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:05.954978 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce51f38b-84c0-4767-b7c2-cffc7ec671e8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=868b5986-0799-4a9f-a261-2da21931822d,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:05.959042 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-57c576e1-3a45-477d-ac6d-1e83cc25de39 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:06.010152 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-728be5c3-c478-4186-82dd-5da8c835cc84 None None] Publish callbacks [] for port, precommit_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:06.015299 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b32a54f2-1b9c-4e5e-8e94-fd6b3de82302 admin admin] Network f70ee550-62a6-48db-bca5-a0b964bbcce9 is scheduled to be hosted by DHCP agent a7e1e7ee-1ce2-474e-9688-58f0884991a4 with binding_index 1 {{(pid=101244) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 16:11:06.039279 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-ce1dac2a-96c4-48e4-955f-f3d9c70cee78 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/quotas/170b9e4079834c589534d39e70e1dba3 HTTP/1.1" status: 200 len: 375 time: 0.1146393 Nov 08 16:11:06.047633 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-b32a54f2-1b9c-4e5e-8e94-fd6b3de82302 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816187-2-iscsi, f70ee550-62a6-48db-bca5-a0b964bbcce9) {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:11:06.073483 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cebfac64-052d-4ab9-841a-81940d8a3f74 None None] Network f70ee550-62a6-48db-bca5-a0b964bbcce9 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:11:06.077411 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-728be5c3-c478-4186-82dd-5da8c835cc84 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:06.107896 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b32a54f2-1b9c-4e5e-8e94-fd6b3de82302 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:06.108807 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b32a54f2-1b9c-4e5e-8e94-fd6b3de82302 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for subnet, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:06.185923 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c51e64a6-111a-4551-9fee-ea5ccf6906d4 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:06.220306 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-2552fc4d-c9c5-4f5a-8b19-d6061200e9a6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:06.278470 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-728be5c3-c478-4186-82dd-5da8c835cc84 None None] Network 75fa9c3e-7bfe-490a-9118-221394c29646 is already hosted by enough agents. {{(pid=101246) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:11:06.281423 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-57c576e1-3a45-477d-ac6d-1e83cc25de39 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:06.300711 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-57c576e1-3a45-477d-ac6d-1e83cc25de39 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:06.319118 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-7e242fa7-3fce-4305-8ab2-4409725cdf7e tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?tenant_id=170b9e4079834c589534d39e70e1dba3&fields=id HTTP/1.1" status: 200 len: 210 time: 0.2162273 Nov 08 16:11:06.331888 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.scheduler.base_scheduler [None req-728be5c3-c478-4186-82dd-5da8c835cc84 None None] Resources bound (agent type, host, resource id): {{(pid=101246) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:11:06.339879 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-728be5c3-c478-4186-82dd-5da8c835cc84 None None] Received port after_create {{(pid=101246) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:11:06.350215 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-b32a54f2-1b9c-4e5e-8e94-fd6b3de82302 admin admin] 10.222.0.37 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 2.4648986 Nov 08 16:11:06.356444 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-aaa7f8ca-8bf6-4f67-b8b2-8819688fd702 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:06.379271 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-aaa7f8ca-8bf6-4f67-b8b2-8819688fd702 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:06.416292 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8f730d81-260d-497a-9430-870b7ddb6ded admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:06.442151 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-57c576e1-3a45-477d-ac6d-1e83cc25de39 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=1d5fb87ca52a4181b753fc9e3cb86146&name=default HTTP/1.1" status: 200 len: 2992 time: 0.8213584 Nov 08 16:11:06.445739 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:06.445919 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57c576e1-3a45-477d-ac6d-1e83cc25de39 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8ca874d1-55f5-464c-a6b3-b53e8317c91e,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:06.448215 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 59238) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:06.477498 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-2552fc4d-c9c5-4f5a-8b19-d6061200e9a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:06.541257 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-0329d5a8-b398-4eab-bbb0-9b3e155e0fe2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:06.564918 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] For port 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:11:06.566109 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-728be5c3-c478-4186-82dd-5da8c835cc84 None None] Pushing event updated for resources: {'Port': ['ID=71c92ac9-ccca-40b1-acfe-69b3046505a6,revision_number=1']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:06.605154 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:06.607114 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24947936-0518-4705-b6d3-45fa5e403e69 None None] Network 2d5b5768-37f3-49a1-b451-2803f6f97429 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:11:06.649549 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-aaa7f8ca-8bf6-4f67-b8b2-8819688fd702 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:06.661134 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-aaa7f8ca-8bf6-4f67-b8b2-8819688fd702 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:06.661351 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2552fc4d-c9c5-4f5a-8b19-d6061200e9a6 admin admin] Network 68f46265-b42a-49a0-8d57-f9362045cd9b is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:11:06.669557 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 59246) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:06.670340 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-aaa7f8ca-8bf6-4f67-b8b2-8819688fd702 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/868b5986-0799-4a9f-a261-2da21931822d HTTP/1.1" status: 204 len: 168 time: 0.7565682 Nov 08 16:11:06.688401 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaa7f8ca-8bf6-4f67-b8b2-8819688fd702 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=868b5986-0799-4a9f-a261-2da21931822d,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:06.700036 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-2552fc4d-c9c5-4f5a-8b19-d6061200e9a6 admin admin] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:11:06.713354 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2552fc4d-c9c5-4f5a-8b19-d6061200e9a6 admin admin] Received port after_create {{(pid=101245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:11:06.715689 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2552fc4d-c9c5-4f5a-8b19-d6061200e9a6 admin admin] Pushing event updated for resources: {'Port': ['ID=570b0fd6-c5f9-427e-a59a-28c493e0cd78,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:06.733873 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-765203b7-fb86-4198-864c-d46b689edde1 service neutron] http://10.222.0.37:9696/v2.0/extensions returned with HTTP 200 {{(pid=101244) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 16:11:06.735017 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-765203b7-fb86-4198-864c-d46b689edde1 service neutron] 10.222.0.37 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1667819 Nov 08 16:11:06.758917 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-dab007ba-0c63-430c-8fa3-4d3a3a9f4077 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:06.786300 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-dab007ba-0c63-430c-8fa3-4d3a3a9f4077 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:06.814728 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Pushing event updated for resources: {'Port': ['ID=2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7,revision_number=3']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:06.837818 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8f730d81-260d-497a-9430-870b7ddb6ded admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-2034870', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-2032353'] for router, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:06.884334 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-728be5c3-c478-4186-82dd-5da8c835cc84 None None] Attempting to bind port 71c92ac9-ccca-40b1-acfe-69b3046505a6 on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:11:06.884691 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-728be5c3-c478-4186-82dd-5da8c835cc84 None None] Attempting to bind port 71c92ac9-ccca-40b1-acfe-69b3046505a6 by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': '7651dfae-d245-4d32-b379-dc243d043404', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646'}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:11:06.888326 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-728be5c3-c478-4186-82dd-5da8c835cc84 None None] Attempting to bind port 71c92ac9-ccca-40b1-acfe-69b3046505a6 on network 75fa9c3e-7bfe-490a-9118-221394c29646 {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:11:06.964730 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.db.api [None req-0329d5a8-b398-4eab-bbb0-9b3e155e0fe2 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=101246) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 08 16:11:06.965417 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG oslo_db.api [None req-0329d5a8-b398-4eab-bbb0-9b3e155e0fe2 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 08 16:11:06.989553 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-728be5c3-c478-4186-82dd-5da8c835cc84 None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 10, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:11:06.989971 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-728be5c3-c478-4186-82dd-5da8c835cc84 None None] Checking segment: {'id': '7651dfae-d245-4d32-b379-dc243d043404', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:11:06.990324 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-728be5c3-c478-4186-82dd-5da8c835cc84 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:06.990702 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-728be5c3-c478-4186-82dd-5da8c835cc84 None None] Bound using segment: {'id': '7651dfae-d245-4d32-b379-dc243d043404', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646'} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:11:06.991405 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-728be5c3-c478-4186-82dd-5da8c835cc84 None None] Bound port: 71c92ac9-ccca-40b1-acfe-69b3046505a6, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7651dfae-d245-4d32-b379-dc243d043404', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646'}}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:11:06.992485 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-728be5c3-c478-4186-82dd-5da8c835cc84 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:07.020025 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5cdc3d7a-a3b5-4753-a2cf-c312936bc57c None None] Network f70ee550-62a6-48db-bca5-a0b964bbcce9 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:11:07.098344 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8f730d81-260d-497a-9430-870b7ddb6ded admin admin] Router e5087790-dc76-4f18-81a3-548feaf21791 is scheduled to L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f with binding_index 1 {{(pid=101244) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 08 16:11:07.114709 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-728be5c3-c478-4186-82dd-5da8c835cc84 None None] For port 71c92ac9-ccca-40b1-acfe-69b3046505a6, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:11:07.123209 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-728be5c3-c478-4186-82dd-5da8c835cc84 None None] For port 71c92ac9-ccca-40b1-acfe-69b3046505a6, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=71c92ac9-ccca-40b1-acfe-69b3046505a6,segment=NetworkSegment(7651dfae-d245-4d32-b379-dc243d043404),segment_id=7651dfae-d245-4d32-b379-dc243d043404)] {{(pid=101246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:11:07.132163 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-a2e6095f-1669-4201-b1ec-d5db4da8ae23 service neutron] 10.222.0.37 "GET /v2.0/networks/8d351af8-ed05-48f5-939b-8cf227b5c91c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2962461 Nov 08 16:11:07.166442 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-728be5c3-c478-4186-82dd-5da8c835cc84 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:07.281108 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59258) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:07.308931 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-95f26ab7-b996-4777-8c8c-6769abf8a737 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:07.331441 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-2552fc4d-c9c5-4f5a-8b19-d6061200e9a6 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:07.366706 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8f730d81-260d-497a-9430-870b7ddb6ded admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:11:07.378529 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] Sync routers for ids ['e5087790-dc76-4f18-81a3-548feaf21791'] in dv-cinder-816187-2-iscsi {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:11:07.392322 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] Routers {'e5087790-dc76-4f18-81a3-548feaf21791'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:11:07.394421 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:10:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['e5087790-dc76-4f18-81a3-548feaf21791'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:11:07.395663 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-e1e05653-8b15-490f-a4ac-86a83eda6ecc service neutron] 10.222.0.37 "GET /v2.0/networks/8d351af8-ed05-48f5-939b-8cf227b5c91c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2035847 Nov 08 16:11:07.414636 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8f730d81-260d-497a-9430-870b7ddb6ded admin admin] Publish callbacks [] for router, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:07.415932 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-8f730d81-260d-497a-9430-870b7ddb6ded admin admin] 10.222.0.37 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 5.5765722 Nov 08 16:11:07.420198 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59272) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:07.443020 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59274) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:07.452568 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0780cb58-a72e-47aa-879c-75b77646c8b7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:07.557190 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-728be5c3-c478-4186-82dd-5da8c835cc84 None None] Pushing event updated for resources: {'Port': ['ID=71c92ac9-ccca-40b1-acfe-69b3046505a6,revision_number=2']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:07.599716 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-dab007ba-0c63-430c-8fa3-4d3a3a9f4077 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:07.606554 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-dab007ba-0c63-430c-8fa3-4d3a3a9f4077 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:07.610948 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-dab007ba-0c63-430c-8fa3-4d3a3a9f4077 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/8ca874d1-55f5-464c-a6b3-b53e8317c91e HTTP/1.1" status: 204 len: 168 time: 1.1565278 Nov 08 16:11:07.700341 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dab007ba-0c63-430c-8fa3-4d3a3a9f4077 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8ca874d1-55f5-464c-a6b3-b53e8317c91e,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:07.720503 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-95f26ab7-b996-4777-8c8c-6769abf8a737 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:07.760249 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-95f26ab7-b996-4777-8c8c-6769abf8a737 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:07.764238 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-2d61f3db-372b-4984-9490-5503d6111af2 None None] Provisioning complete for port 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:07.764729 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-2d61f3db-372b-4984-9490-5503d6111af2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:07.971363 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c51e64a6-111a-4551-9fee-ea5ccf6906d4 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:07.980744 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-95f26ab7-b996-4777-8c8c-6769abf8a737 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=2e235b6377a740adb1f8899f5d541a83&name=default HTTP/1.1" status: 200 len: 2992 time: 0.6985972 Nov 08 16:11:07.989201 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-7dbb39ff-25a1-496f-a97d-04c020db8c92 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:07.996844 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-7dbb39ff-25a1-496f-a97d-04c020db8c92 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/networks?id=f70ee550-62a6-48db-bca5-a0b964bbcce9 HTTP/1.1" status: 200 len: 815 time: 0.5527697 Nov 08 16:11:08.001851 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] Set router e5087790-dc76-4f18-81a3-548feaf21791 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:11:08.002034 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 59294) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:08.044662 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c51e64a6-111a-4551-9fee-ea5ccf6906d4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:08.086719 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4a03c93c-931c-4ca0-ab2f-af588cbd78c7 req-b228af7c-3ab9-4034-9a7a-365932af0b21 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 210 time: 0.1805813 Nov 08 16:11:08.095527 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-c956f11e-bfeb-4fe9-b2e2-40732e99e2a3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/quotas/549e9715f7424ff5b3b252f354adafe9 HTTP/1.1" status: 200 len: 375 time: 0.0967913 Nov 08 16:11:08.115934 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-e95005dd-dbb3-45ca-8126-d5c036b88ae9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:08.135273 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95f26ab7-b996-4777-8c8c-6769abf8a737 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cb68ec7f-aa93-4bfe-844b-b6de814f49b2,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:08.212424 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0780cb58-a72e-47aa-879c-75b77646c8b7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:08.250200 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0780cb58-a72e-47aa-879c-75b77646c8b7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:08.268053 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'name': 'tempest-AttachVolumeShelveTestJSON-1204269590-router', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118'}], 'enable_snat': True}, 'gw_port_id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:01Z', 'updated_at': '2021-11-08T16:11:06Z', 'revision_number': 3, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'gw_port': {'id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:db:96', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:04Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:11:08.294380 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-d493046e-2fdd-4d32-ab66-0d898a541d06 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?tenant_id=549e9715f7424ff5b3b252f354adafe9&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1957159 Nov 08 16:11:08.311030 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-2552fc4d-c9c5-4f5a-8b19-d6061200e9a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-2034870', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-2032353'] for router, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:08.332464 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-0780cb58-a72e-47aa-879c-75b77646c8b7 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=125aa1539c1645e289cea5d976924f12&name=default HTTP/1.1" status: 200 len: 2992 time: 1.6561749 Nov 08 16:11:08.340769 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0780cb58-a72e-47aa-879c-75b77646c8b7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=75d83f12-d1b1-4ba0-b843-c39d89377d78,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:08.343114 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] Checking router: e5087790-dc76-4f18-81a3-548feaf21791 for host: dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:11:08.345036 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 59304) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:08.346605 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] Updating router e5087790-dc76-4f18-81a3-548feaf21791 port d3af559a-99c6-40a2-85f2-bab38b3887e1 binding host dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 16:11:08.427944 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:08.652277 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_common [None req-c51e64a6-111a-4551-9fee-ea5ccf6906d4 admin admin] Allocated IP 172.27.3.169 (68f46265-b42a-49a0-8d57-f9362045cd9b/4728e4be-5a19-43c0-89cf-ced2a190645d/08dc39b4-7c2e-4499-b08d-d80c11a6d6ca) {{(pid=101245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:11:08.670717 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6fbbd597-0b44-45db-8c3e-32a1cf941e48 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:08.817074 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-369ea768-ff7e-4008-89d8-94d1d4813c29 service neutron] http://10.222.0.37:9696/v2.0/extensions returned with HTTP 200 {{(pid=101244) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 16:11:08.818090 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-369ea768-ff7e-4008-89d8-94d1d4813c29 service neutron] 10.222.0.37 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3051138 Nov 08 16:11:08.897257 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 71c92ac9-ccca-40b1-acfe-69b3046505a6 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:11:08.917644 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-50a17497-b012-4d45-a453-6a97bebed8c0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:08.923745 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c51e64a6-111a-4551-9fee-ea5ccf6906d4 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:08.941548 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6fbbd597-0b44-45db-8c3e-32a1cf941e48 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:08.974346 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 71c92ac9-ccca-40b1-acfe-69b3046505a6 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:08.974724 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:08.998563 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b5734bbd-128d-4e37-9bbe-991966b2aca0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:09.054877 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6fbbd597-0b44-45db-8c3e-32a1cf941e48 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:09.062702 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6fbbd597-0b44-45db-8c3e-32a1cf941e48 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:09.064425 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-6fbbd597-0b44-45db-8c3e-32a1cf941e48 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/cb68ec7f-aa93-4bfe-844b-b6de814f49b2 HTTP/1.1" status: 204 len: 168 time: 1.0581083 Nov 08 16:11:09.087941 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:09.129610 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1bb45b1b-1ed7-49d4-a927-4758286aad87 None None] Network 75fa9c3e-7bfe-490a-9118-221394c29646 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:11:09.139337 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fbbd597-0b44-45db-8c3e-32a1cf941e48 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cb68ec7f-aa93-4bfe-844b-b6de814f49b2,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:09.149964 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-50a17497-b012-4d45-a453-6a97bebed8c0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:09.232142 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-93574cb6-b738-465f-bdfb-2686215fabbd service neutron] 10.222.0.37 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4007413 Nov 08 16:11:09.258003 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-31eab3a8-4404-4e49-b08a-b8e3e4b2b206 req-5ffb4f79-3825-4b35-8481-5307efb37aa0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 210 time: 0.0507903 Nov 08 16:11:09.267581 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2552fc4d-c9c5-4f5a-8b19-d6061200e9a6 admin admin] Router c3f55c44-bed1-4955-9229-dac3c412f010 is scheduled to L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f with binding_index 1 {{(pid=101245) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 08 16:11:09.329403 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c51e64a6-111a-4551-9fee-ea5ccf6906d4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:09.333651 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] For port 71c92ac9-ccca-40b1-acfe-69b3046505a6, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=71c92ac9-ccca-40b1-acfe-69b3046505a6,segment=NetworkSegment(7651dfae-d245-4d32-b379-dc243d043404),segment_id=7651dfae-d245-4d32-b379-dc243d043404)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:11:09.375748 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:09.376540 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:11:09.408168 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-50a17497-b012-4d45-a453-6a97bebed8c0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:09.410469 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-50a17497-b012-4d45-a453-6a97bebed8c0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:09.415339 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-50a17497-b012-4d45-a453-6a97bebed8c0 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/75d83f12-d1b1-4ba0-b843-c39d89377d78 HTTP/1.1" status: 204 len: 168 time: 1.0458200 Nov 08 16:11:09.467536 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-687b9d22-7099-443c-86be-72cebe3a11a9 None None] Provisioning complete for port 71c92ac9-ccca-40b1-acfe-69b3046505a6 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:09.467990 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-687b9d22-7099-443c-86be-72cebe3a11a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:09.482879 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c51e64a6-111a-4551-9fee-ea5ccf6906d4 admin admin] Network 68f46265-b42a-49a0-8d57-f9362045cd9b is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:11:09.495318 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-c51e64a6-111a-4551-9fee-ea5ccf6906d4 admin admin] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:11:09.498000 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c51e64a6-111a-4551-9fee-ea5ccf6906d4 admin admin] Received port after_create {{(pid=101245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:11:09.518151 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50a17497-b012-4d45-a453-6a97bebed8c0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=75d83f12-d1b1-4ba0-b843-c39d89377d78,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:09.650204 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] Publish callbacks [] for port, precommit_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:09.667583 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:09.728830 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:09.729199 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:09.760324 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13c402a2-d687-4e1a-9b6c-45f60e9ae32a None None] Pushing event updated for resources: {'Port': ['ID=d3af559a-99c6-40a2-85f2-bab38b3887e1,revision_number=2']} {{(pid=101247) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:09.766562 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c51e64a6-111a-4551-9fee-ea5ccf6906d4 admin admin] Pushing event updated for resources: {'Port': ['ID=08dc39b4-7c2e-4499-b08d-d80c11a6d6ca,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:09.778167 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-cc3bd66f-e6db-4e51-b9d1-dd2fdda572e1 service neutron] 10.222.0.37 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5219920 Nov 08 16:11:09.794521 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13c402a2-d687-4e1a-9b6c-45f60e9ae32a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:09.794896 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13c402a2-d687-4e1a-9b6c-45f60e9ae32a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:09.797285 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13c402a2-d687-4e1a-9b6c-45f60e9ae32a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:09.797642 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13c402a2-d687-4e1a-9b6c-45f60e9ae32a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:09.798071 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13c402a2-d687-4e1a-9b6c-45f60e9ae32a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:09.798709 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13c402a2-d687-4e1a-9b6c-45f60e9ae32a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:09.799063 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13c402a2-d687-4e1a-9b6c-45f60e9ae32a None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:09.800575 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13c402a2-d687-4e1a-9b6c-45f60e9ae32a None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:09.800970 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13c402a2-d687-4e1a-9b6c-45f60e9ae32a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:09.801784 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13c402a2-d687-4e1a-9b6c-45f60e9ae32a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:09.802871 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13c402a2-d687-4e1a-9b6c-45f60e9ae32a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:09.803910 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13c402a2-d687-4e1a-9b6c-45f60e9ae32a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13c402a2-d687-4e1a-9b6c-45f60e9ae32a None None] Tracked resource versions report: Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: pushed versions: Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: { 'AddressGroup': {'1.2'}, Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: 'ConntrackHelper': {'1.0'}, Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: 'Log': {'1.0'}, Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: 'Network': {'1.1'}, Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: 'Port': {'1.7'}, Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: 'PortForwarding': {'1.2'}, Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: 'QosPolicy': {'1.10'}, Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: 'SecurityGroup': {'1.5'}, Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: 'SecurityGroupRule': {'1.2'}, Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: 'SubPort': {'1.0'}, Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: 'Subnet': {'1.1'}, Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: 'Trunk': {'1.1'}} Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: consumer versions: Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: { DHCP agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: HyperV agent@hv-cinder-81618: {}, Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: L3 agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: Metadata agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: Metering agent@dv-cinder-816187-2-iscsi: {}, Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: Open vSwitch agent@dv-cinder-816187-2-iscsi: { 'AddressGroup': '1.2', Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: 'ConntrackHelper': '1.0', Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: 'Log': '1.0', Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: 'Network': '1.1', Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: 'Port': '1.7', Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: 'PortForwarding': '1.2', Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: 'QosPolicy': '1.10', Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: 'SecurityGroup': '1.5', Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: 'SecurityGroupRule': '1.2', Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: 'SubPort': '1.0', Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: 'Subnet': '1.1', Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: 'Trunk': '1.1'}} Nov 08 16:11:09.810182 dv-cinder-816187-2-iscsi neutron-server[101247]: {{(pid=101247) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 08 16:11:09.882003 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Pushing event updated for resources: {'Port': ['ID=71c92ac9-ccca-40b1-acfe-69b3046505a6,revision_number=3']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:09.899559 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] Attempting to bind port d3af559a-99c6-40a2-85f2-bab38b3887e1 on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:11:09.900862 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] Attempting to bind port d3af559a-99c6-40a2-85f2-bab38b3887e1 by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}] {{(pid=101247) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:11:09.901539 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] Attempting to bind port d3af559a-99c6-40a2-85f2-bab38b3887e1 on network 68f46265-b42a-49a0-8d57-f9362045cd9b {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:11:09.916935 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 10, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:11:09.918833 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] Checking segment: {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101247) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:11:09.920258 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:09.920839 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] Bound using segment: {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'} {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:11:09.922391 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] Bound port: d3af559a-99c6-40a2-85f2-bab38b3887e1, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}}] {{(pid=101247) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:11:09.925406 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:09.948489 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2552fc4d-c9c5-4f5a-8b19-d6061200e9a6 admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101245) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:11:09.965973 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [None req-b5734bbd-128d-4e37-9bbe-991966b2aca0 admin admin] Allocated IP 172.20.0.1 (e0e08679-82fe-47eb-90b6-49a1713fdaca/fc52ff8b-1692-487b-a0de-f6290e65d880/9e08c20e-219c-4cd8-b6fe-30829b440d06) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:11:09.975414 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] Sync routers for ids ['c3f55c44-bed1-4955-9229-dac3c412f010'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:11:10.004238 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-2552fc4d-c9c5-4f5a-8b19-d6061200e9a6 admin admin] Publish callbacks [] for router, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:10.004238 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-2552fc4d-c9c5-4f5a-8b19-d6061200e9a6 admin admin] 10.222.0.37 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 6.7202406 Nov 08 16:11:10.004638 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 59368) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:10.050825 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.db [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] For port d3af559a-99c6-40a2-85f2-bab38b3887e1, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101247) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:11:10.054948 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.db [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] For port d3af559a-99c6-40a2-85f2-bab38b3887e1, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=d3af559a-99c6-40a2-85f2-bab38b3887e1,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101247) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:11:10.073603 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:10.168252 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b5734bbd-128d-4e37-9bbe-991966b2aca0 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:10.176412 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59372) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:10.210835 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0aeb8ebd-192c-4d61-add7-a013b531407f admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:10.282773 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] Routers {'c3f55c44-bed1-4955-9229-dac3c412f010'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:11:10.283385 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:10:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['c3f55c44-bed1-4955-9229-dac3c412f010'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:11:10.286980 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] Routers {'e5087790-dc76-4f18-81a3-548feaf21791'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:11:10.287876 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:10:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['e5087790-dc76-4f18-81a3-548feaf21791'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:11:10.370184 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0aeb8ebd-192c-4d61-add7-a013b531407f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:10.428379 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13c402a2-d687-4e1a-9b6c-45f60e9ae32a None None] Pushing event updated for resources: {'Port': ['ID=d3af559a-99c6-40a2-85f2-bab38b3887e1,revision_number=3']} {{(pid=101247) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:10.470939 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1d256108-fc1e-4fe5-bbe2-5e1d92d099a9 req-b8b96f38-63db-4c1a-8010-6d83d62bb33e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 210 time: 0.0960016 Nov 08 16:11:10.501419 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0aeb8ebd-192c-4d61-add7-a013b531407f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:10.582916 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0aeb8ebd-192c-4d61-add7-a013b531407f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9130177a-6d08-4d83-8999-51fab4dcf7d1,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:10.708020 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c51e64a6-111a-4551-9fee-ea5ccf6906d4 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:10.716826 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] Set router e5087790-dc76-4f18-81a3-548feaf21791 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:11:10.720296 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9ee9b6d3-ad86-49d2-82d8-3eb257d87281 req-ddc8c598-7d4a-40e3-86b9-25f888a00936 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 210 time: 0.0915987 Nov 08 16:11:10.759811 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7c15bac3-73ec-47d3-987d-e4bec7f23664 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:10.771944 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-0aeb8ebd-192c-4d61-add7-a013b531407f admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=51fe8198439347feabc97d8a898edfd0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5808280 Nov 08 16:11:10.772601 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59398) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:10.809697 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b5734bbd-128d-4e37-9bbe-991966b2aca0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:10.816794 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] Set router c3f55c44-bed1-4955-9229-dac3c412f010 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:11:10.875587 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 71c92ac9-ccca-40b1-acfe-69b3046505a6 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:11:10.972544 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5734bbd-128d-4e37-9bbe-991966b2aca0 admin admin] Pushing event updated for resources: {'Port': ['ID=9e08c20e-219c-4cd8-b6fe-30829b440d06,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:10.997042 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5734bbd-128d-4e37-9bbe-991966b2aca0 admin admin] Network e0e08679-82fe-47eb-90b6-49a1713fdaca is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:11:11.004559 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-b5734bbd-128d-4e37-9bbe-991966b2aca0 admin admin] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:11:11.011726 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5734bbd-128d-4e37-9bbe-991966b2aca0 admin admin] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:11:11.020265 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b5734bbd-128d-4e37-9bbe-991966b2aca0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-2033204'] for router_interface, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:11.160180 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.25', 50838) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:11.283631 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'name': 'tempest-AttachVolumeShelveTestJSON-1204269590-router', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118'}], 'enable_snat': True}, 'gw_port_id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:01Z', 'updated_at': '2021-11-08T16:11:06Z', 'revision_number': 3, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'gw_port': {'id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:db:96', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:11:11.365494 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdd6a0ac-fd98-4890-b87c-a8a3c848309a None None] The sync data for ids ['e5087790-dc76-4f18-81a3-548feaf21791'] in dv-cinder-816187-2-iscsi is: [{'id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'name': 'tempest-AttachVolumeShelveTestJSON-1204269590-router', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118'}], 'enable_snat': True}, 'gw_port_id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:01Z', 'updated_at': '2021-11-08T16:11:06Z', 'revision_number': 3, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'gw_port': {'id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:db:96', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}] {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:11:11.529905 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-1b874d51-c0aa-42b0-be98-d4aa1b6dbc4d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:11.656491 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-7d3bf379-4f2f-4b35-b776-b0db6e2d5ada None None] Provisioning complete for port 71c92ac9-ccca-40b1-acfe-69b3046505a6 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:11.657161 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7d3bf379-4f2f-4b35-b776-b0db6e2d5ada None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:11.667076 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:11.721903 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-1b874d51-c0aa-42b0-be98-d4aa1b6dbc4d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:11.748115 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 71c92ac9-ccca-40b1-acfe-69b3046505a6 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:11.748284 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:11.809471 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c3417b46-e0f5-4700-9b66-9a298a475e06 req-300f547c-776a-4c5d-84b4-95f0cd8457b3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 210 time: 0.2211747 Nov 08 16:11:11.904271 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'name': 'tempest-AttachVolumeTestJSON-272347721-router', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128'}], 'enable_snat': True}, 'gw_port_id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:07Z', 'revision_number': 3, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'gw_port': {'id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:97:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:05Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:11:11.909787 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c51e64a6-111a-4551-9fee-ea5ccf6906d4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-2034870', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-2032353'] for router, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:11.942469 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b5734bbd-128d-4e37-9bbe-991966b2aca0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:12.060478 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] Checking router: c3f55c44-bed1-4955-9229-dac3c412f010 for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:11:12.061425 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] Updating router c3f55c44-bed1-4955-9229-dac3c412f010 port 570b0fd6-c5f9-427e-a59a-28c493e0cd78 binding host dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 16:11:12.094075 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-1b874d51-c0aa-42b0-be98-d4aa1b6dbc4d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:12.096990 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-1b874d51-c0aa-42b0-be98-d4aa1b6dbc4d admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:12.098646 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-1b874d51-c0aa-42b0-be98-d4aa1b6dbc4d admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/9130177a-6d08-4d83-8999-51fab4dcf7d1 HTTP/1.1" status: 204 len: 168 time: 1.3177402 Nov 08 16:11:12.134427 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-029faaba-8bcb-47f0-bf07-8b5fd9e4f7d8 req-275e7583-5a63-442c-a409-df76a5b62d1b tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 210 time: 0.0658405 Nov 08 16:11:12.153151 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b874d51-c0aa-42b0-be98-d4aa1b6dbc4d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9130177a-6d08-4d83-8999-51fab4dcf7d1,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:12.235328 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:12.369930 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b5734bbd-128d-4e37-9bbe-991966b2aca0 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:12.381499 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b5734bbd-128d-4e37-9bbe-991966b2aca0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:12.382375 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b5734bbd-128d-4e37-9bbe-991966b2aca0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1599525', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-2033312'] for router_interface, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:12.465289 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-4980f33e-ae43-4079-abba-2e57bab3e08c None None] Provisioning complete for port 9e08c20e-219c-4cd8-b6fe-30829b440d06 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:12.465658 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-4980f33e-ae43-4079-abba-2e57bab3e08c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:12.521145 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5734bbd-128d-4e37-9bbe-991966b2aca0 admin admin] Pushing event updated for resources: {'Port': ['ID=9e08c20e-219c-4cd8-b6fe-30829b440d06,revision_number=2']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:12.543371 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-078538b9-de56-477e-8aa6-f85464d5bf57 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:12.545304 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-078538b9-de56-477e-8aa6-f85464d5bf57 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.25 "GET /v2.0/networks?id=8d351af8-ed05-48f5-939b-8cf227b5c91c HTTP/1.1" status: 200 len: 811 time: 1.3834949 Nov 08 16:11:12.614196 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-c27c1084-1fa5-470a-8d72-0419fb2d49e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Request body: {'port': {'device_id': 'ec4f96b9-4128-4da6-9880-95a0f72fd4e2', 'network_id': '8d351af8-ed05-48f5-939b-8cf227b5c91c', 'admin_state_up': True, 'tenant_id': '170b9e4079834c589534d39e70e1dba3'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:12.761817 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 59496) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:12.788690 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5734bbd-128d-4e37-9bbe-991966b2aca0 admin admin] Network e0e08679-82fe-47eb-90b6-49a1713fdaca is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:11:12.791284 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-b5734bbd-128d-4e37-9bbe-991966b2aca0 admin admin] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:11:13.010657 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device d3af559a-99c6-40a2-85f2-bab38b3887e1 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:11:13.052401 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.25', 50844) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:13.095050 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-4980f33e-ae43-4079-abba-2e57bab3e08c None None] Port 9e08c20e-219c-4cd8-b6fe-30829b440d06 cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:11:13.233991 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c51e64a6-111a-4551-9fee-ea5ccf6906d4 admin admin] Router cc1c69bc-09ff-4004-b958-600b83b84026 is scheduled to L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f with binding_index 1 {{(pid=101245) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 08 16:11:13.236298 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b5734bbd-128d-4e37-9bbe-991966b2aca0 admin admin] Router e5087790-dc76-4f18-81a3-548feaf21791 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:11:13.351664 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-a69164c5-d1f8-4e71-a7c7-2eb79f28e801 None None] Provisioning complete for port 9e08c20e-219c-4cd8-b6fe-30829b440d06 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:13.352097 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-a69164c5-d1f8-4e71-a7c7-2eb79f28e801 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:13.377034 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5487a5af-17d4-4304-93f6-d906dd22726c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:13.467094 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:13.557468 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1095210c-ca27-4de3-aaa4-3f23fd30f357 req-662598ab-8fe7-420e-b654-c26c7fdeb961 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 210 time: 0.2673423 Nov 08 16:11:13.561618 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-775de92a-d3d8-42e3-adfe-ee4662f671bf req-c2073bed-201f-4f88-8710-78d589dd0497 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 210 time: 0.1252549 Nov 08 16:11:13.598615 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port d3af559a-99c6-40a2-85f2-bab38b3887e1 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:13.598999 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:13.624362 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5009b3a6-a546-4521-b9ba-d1d74e6f9afd admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:13.630577 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-a69164c5-d1f8-4e71-a7c7-2eb79f28e801 None None] Port 9e08c20e-219c-4cd8-b6fe-30829b440d06 cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:11:13.692148 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-c27c1084-1fa5-470a-8d72-0419fb2d49e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Made reservation on behalf of 170b9e4079834c589534d39e70e1dba3 for: {'port': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:11:13.695947 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-c27c1084-1fa5-470a-8d72-0419fb2d49e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:13.812422 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] Publish callbacks [] for port, precommit_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:13.831407 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:13.975488 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7984ce5-efae-4494-9685-7032c14b67f2 None None] Pushing event updated for resources: {'Port': ['ID=570b0fd6-c5f9-427e-a59a-28c493e0cd78,revision_number=2']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:14.093361 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b5734bbd-128d-4e37-9bbe-991966b2aca0 admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:11:14.113173 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-b5734bbd-128d-4e37-9bbe-991966b2aca0 admin admin] 10.222.0.37 "PUT /v2.0/routers/e5087790-dc76-4f18-81a3-548feaf21791/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.6918201 Nov 08 16:11:14.122788 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:14.143883 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:14.149660 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] Attempting to bind port 570b0fd6-c5f9-427e-a59a-28c493e0cd78 on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:11:14.149916 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] Attempting to bind port 570b0fd6-c5f9-427e-a59a-28c493e0cd78 by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:11:14.150268 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] Attempting to bind port 570b0fd6-c5f9-427e-a59a-28c493e0cd78 on network 68f46265-b42a-49a0-8d57-f9362045cd9b {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:11:14.165515 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-3c30cb5d-7c2a-4a9b-b970-5c5a9aafbd5a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:14.170178 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 11, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:11:14.170433 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] Checking segment: {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:11:14.171022 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:14.171934 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] Bound using segment: {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:11:14.172511 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] Bound port: 570b0fd6-c5f9-427e-a59a-28c493e0cd78, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:11:14.172908 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:14.183678 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-3c30cb5d-7c2a-4a9b-b970-5c5a9aafbd5a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.25 "GET /v2.0/networks?id=f70ee550-62a6-48db-bca5-a0b964bbcce9 HTTP/1.1" status: 200 len: 815 time: 1.1060224 Nov 08 16:11:14.211185 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] For port d3af559a-99c6-40a2-85f2-bab38b3887e1, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=d3af559a-99c6-40a2-85f2-bab38b3887e1,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:11:14.217494 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:14.380745 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-48d31f79-494a-4895-8ee0-e66083a156c9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Request body: {'port': {'device_id': 'dfa35d29-db7d-4fab-a001-7db0d508d70a', 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9', 'admin_state_up': True, 'tenant_id': '549e9715f7424ff5b3b252f354adafe9'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:14.406953 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Pushing event updated for resources: {'Port': ['ID=d3af559a-99c6-40a2-85f2-bab38b3887e1,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:14.426913 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] For port 570b0fd6-c5f9-427e-a59a-28c493e0cd78, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:11:14.437887 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] For port 570b0fd6-c5f9-427e-a59a-28c493e0cd78, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=570b0fd6-c5f9-427e-a59a-28c493e0cd78,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:11:14.462191 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:14.531917 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] Sync routers for ids ['e5087790-dc76-4f18-81a3-548feaf21791'] in dv-cinder-816187-2-iscsi {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:11:14.551048 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] Routers {'e5087790-dc76-4f18-81a3-548feaf21791'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:11:14.551650 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7984ce5-efae-4494-9685-7032c14b67f2 None None] Pushing event updated for resources: {'Port': ['ID=570b0fd6-c5f9-427e-a59a-28c493e0cd78,revision_number=3']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:14.552910 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:11:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['e5087790-dc76-4f18-81a3-548feaf21791'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:11:14.574153 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] Routers {'c3f55c44-bed1-4955-9229-dac3c412f010'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:11:14.575241 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:11:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['c3f55c44-bed1-4955-9229-dac3c412f010'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:11:14.799295 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e62765d8-f342-4cb7-afb9-5ad472b2cdc6 req-b1bfd309-d322-4f3b-b70e-6b6ae6db1896 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 210 time: 0.0850339 Nov 08 16:11:14.806035 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] Set router c3f55c44-bed1-4955-9229-dac3c412f010 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:11:14.806411 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59554) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:14.844568 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c51e64a6-111a-4551-9fee-ea5ccf6906d4 admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101245) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:11:14.878636 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] Sync routers for ids ['cc1c69bc-09ff-4004-b958-600b83b84026'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:11:14.886165 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device d3af559a-99c6-40a2-85f2-bab38b3887e1 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:11:14.973027 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1b04a20a-2d83-477c-9547-8ce246ad57dd req-7124ef18-3d83-4956-8422-22cb3cb73cfb tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 210 time: 0.0863204 Nov 08 16:11:15.011399 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] Set router e5087790-dc76-4f18-81a3-548feaf21791 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:11:15.074886 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f61cade3-a500-4fd4-ac1a-d15da022c136 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:15.174840 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_common [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-c27c1084-1fa5-470a-8d72-0419fb2d49e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Allocated IP 172.20.0.12 (8d351af8-ed05-48f5-939b-8cf227b5c91c/caeb6ff4-65b7-4e61-97f1-b93b8755570e/70c72d16-a0e9-49bb-b7b8-ef436d81a390) {{(pid=101245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:11:15.186582 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c51e64a6-111a-4551-9fee-ea5ccf6906d4 admin admin] Publish callbacks [] for router, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:15.208541 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-c51e64a6-111a-4551-9fee-ea5ccf6906d4 admin admin] 10.222.0.37 "POST /v2.0/routers HTTP/1.1" status: 201 len: 930 time: 9.5402911 Nov 08 16:11:15.216200 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 59560) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:15.227844 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f61cade3-a500-4fd4-ac1a-d15da022c136 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:15.234286 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f61cade3-a500-4fd4-ac1a-d15da022c136 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:15.266267 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5009b3a6-a546-4521-b9ba-d1d74e6f9afd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:15.286070 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] Routers {'cc1c69bc-09ff-4004-b958-600b83b84026'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:11:15.286761 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:11:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['cc1c69bc-09ff-4004-b958-600b83b84026'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:11:15.297939 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_common [None req-5487a5af-17d4-4304-93f6-d906dd22726c admin admin] Allocated IP 172.20.0.1 (75fa9c3e-7bfe-490a-9118-221394c29646/8b248e51-4c70-4980-9452-c6b625bf96dd/30759480-5159-4b6e-a269-86ac7d105870) {{(pid=101245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:11:15.327237 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f61cade3-a500-4fd4-ac1a-d15da022c136 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f17c899e-3da6-4ea1-b4e1-7abc924c2d43,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:15.392630 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-f61cade3-a500-4fd4-ac1a-d15da022c136 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=48fba47071734190b8af6340c060dc14&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5849619 Nov 08 16:11:15.397318 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59562) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:15.492529 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59564) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:15.501491 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port d3af559a-99c6-40a2-85f2-bab38b3887e1 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:15.501890 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:15.544983 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-b2f522c8-331e-4a21-aaf5-63eff55b5514 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1194879682', 'description': 'tempest-description--2044744741'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:15.546057 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5009b3a6-a546-4521-b9ba-d1d74e6f9afd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:15.565581 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-465ce01b-1ccb-4c33-b8a3-c8b34e4e7b89 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:15.612990 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'name': 'tempest-AttachVolumeShelveTestJSON-1204269590-router', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118'}], 'enable_snat': True}, 'gw_port_id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:01Z', 'updated_at': '2021-11-08T16:11:11Z', 'revision_number': 4, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'gw_port': {'id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:db:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '9e08c20e-219c-4cd8-b6fe-30829b440d06', 'name': '', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'mac_address': 'fa:16:3e:e6:20:51', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:09Z', 'updated_at': '2021-11-08T16:11:12Z', 'revision_number': 2, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'subnets': [{'id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:11:15.626703 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-48d31f79-494a-4895-8ee0-e66083a156c9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Made reservation on behalf of 549e9715f7424ff5b3b252f354adafe9 for: {'port': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:11:15.630768 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-48d31f79-494a-4895-8ee0-e66083a156c9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:15.652358 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b2f522c8-331e-4a21-aaf5-63eff55b5514 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:15.691657 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] Checking router: e5087790-dc76-4f18-81a3-548feaf21791 for host: dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:11:15.691940 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] Updating router e5087790-dc76-4f18-81a3-548feaf21791 port 9e08c20e-219c-4cd8-b6fe-30829b440d06 binding host dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 16:11:15.696342 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5009b3a6-a546-4521-b9ba-d1d74e6f9afd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f0e07a79-4d91-463a-b624-56bb86996784,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:15.699373 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-465ce01b-1ccb-4c33-b8a3-c8b34e4e7b89 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:15.749186 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] Set router cc1c69bc-09ff-4004-b958-600b83b84026 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:11:15.793325 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:15.845249 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-465ce01b-1ccb-4c33-b8a3-c8b34e4e7b89 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:15.850332 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-465ce01b-1ccb-4c33-b8a3-c8b34e4e7b89 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:15.852393 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-465ce01b-1ccb-4c33-b8a3-c8b34e4e7b89 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/f17c899e-3da6-4ea1-b4e1-7abc924c2d43 HTTP/1.1" status: 204 len: 168 time: 0.4537141 Nov 08 16:11:15.857204 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b2f522c8-331e-4a21-aaf5-63eff55b5514 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:15.869526 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-465ce01b-1ccb-4c33-b8a3-c8b34e4e7b89 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f17c899e-3da6-4ea1-b4e1-7abc924c2d43,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:15.886097 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b2f522c8-331e-4a21-aaf5-63eff55b5514 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:16.068597 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fc225157-3a87-4f3c-b245-8918184c8d9e req-75199dca-398f-42b1-bcef-f119f3708871 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 210 time: 0.1461606 Nov 08 16:11:16.080895 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b2f522c8-331e-4a21-aaf5-63eff55b5514 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:16.083411 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-b2f522c8-331e-4a21-aaf5-63eff55b5514 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.5496848 Nov 08 16:11:16.097899 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59576) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:16.103753 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-78df93e5-a253-4e61-8f95-2d792a849596 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Request body: {'security_group_rule': {'security_group_id': '25b22689-a549-4355-8242-c53382d480a6', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:16.143809 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2f522c8-331e-4a21-aaf5-63eff55b5514 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Pushing event updated for resources: {'SecurityGroup': ['ID=25b22689-a549-4355-8242-c53382d480a6,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:16.242381 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:16.310272 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-67123b31-1ada-4a22-813e-379ba7f6878b req-4666413c-05cf-4fd6-925a-d5758131bbd8 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 210 time: 0.1110516 Nov 08 16:11:16.358173 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-78df93e5-a253-4e61-8f95-2d792a849596 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:16.378271 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'name': 'tempest-AttachVolumeTestJSON-272347721-router', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128'}], 'enable_snat': True}, 'gw_port_id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:07Z', 'revision_number': 3, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'gw_port': {'id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:97:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:11:16.419561 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f1f3a3d-a49a-4226-82dc-00ee02cd7660 None None] The sync data for ids ['c3f55c44-bed1-4955-9229-dac3c412f010'] in dv-cinder-816187-2-iscsi is: [{'id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'name': 'tempest-AttachVolumeTestJSON-272347721-router', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128'}], 'enable_snat': True}, 'gw_port_id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:07Z', 'revision_number': 3, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'gw_port': {'id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:97:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:11:16.463812 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc1c69bc-09ff-4004-b958-600b83b84026', 'name': 'tempest-ServerRescueNegativeTestJSON-593854580-router', 'tenant_id': '4818358a827143eb9ace58a26713cdf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.169'}], 'enable_snat': True}, 'gw_port_id': '08dc39b4-7c2e-4499-b08d-d80c11a6d6ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:09Z', 'revision_number': 3, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'gw_port': {'id': '08dc39b4-7c2e-4499-b08d-d80c11a6d6ca', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:2d:58:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc1c69bc-09ff-4004-b958-600b83b84026', 'device_owner': 'network:router_gateway', 'standard_attr_id': 98, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:08Z', 'updated_at': '2021-11-08T16:11:08Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:11:16.537873 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] Checking router: cc1c69bc-09ff-4004-b958-600b83b84026 for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:11:16.537873 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] Updating router cc1c69bc-09ff-4004-b958-600b83b84026 port 08dc39b4-7c2e-4499-b08d-d80c11a6d6ca binding host dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 16:11:16.557925 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-78df93e5-a253-4e61-8f95-2d792a849596 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:16.577310 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-78df93e5-a253-4e61-8f95-2d792a849596 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:16.642585 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78df93e5-a253-4e61-8f95-2d792a849596 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0ee7b277-78bc-4594-988d-25e05d27c3c3,revision_number=0']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:16.645828 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_common [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-48d31f79-494a-4895-8ee0-e66083a156c9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Allocated IP 172.20.0.7 (f70ee550-62a6-48db-bca5-a0b964bbcce9/cd23e532-b366-42a0-82e4-ec7326cf3b48/4020a644-ef2e-4dd8-931a-cfccef4e7b15) {{(pid=101245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:11:16.649027 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:16.665425 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-78df93e5-a253-4e61-8f95-2d792a849596 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:16.671103 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-78df93e5-a253-4e61-8f95-2d792a849596 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5718496 Nov 08 16:11:16.671705 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59582) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:16.683791 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59584) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:16.702136 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-7c842fe4-ab29-4cb1-bd79-3697aeec9e56 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Request body: {'security_group_rule': {'security_group_id': '25b22689-a549-4355-8242-c53382d480a6', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:16.730115 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-91267e4e-3e91-437a-93d5-c629927d7923 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:16.851826 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7c842fe4-ab29-4cb1-bd79-3697aeec9e56 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:16.935659 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-5009b3a6-a546-4521-b9ba-d1d74e6f9afd admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=6168044364ed4374bbebeace2a43cddc&name=default HTTP/1.1" status: 200 len: 2996 time: 4.1655169 Nov 08 16:11:16.940545 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59586) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:16.960999 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] Publish callbacks [] for port, precommit_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:17.000852 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:17.158461 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5487a5af-17d4-4304-93f6-d906dd22726c admin admin] Publish callbacks [] for port, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:17.173498 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63e5fe08-c35d-48a9-9213-b815bbad24d4 None None] Pushing event updated for resources: {'Port': ['ID=9e08c20e-219c-4cd8-b6fe-30829b440d06,revision_number=3']} {{(pid=101247) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:17.182756 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7c842fe4-ab29-4cb1-bd79-3697aeec9e56 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:17.300743 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7c842fe4-ab29-4cb1-bd79-3697aeec9e56 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:17.364964 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] Attempting to bind port 9e08c20e-219c-4cd8-b6fe-30829b440d06 on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:11:17.365332 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] Attempting to bind port 9e08c20e-219c-4cd8-b6fe-30829b440d06 by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': '13aab495-f4c4-414c-b50c-fd22b4e0ef0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 188, 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca'}] {{(pid=101247) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:11:17.367818 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] Attempting to bind port 9e08c20e-219c-4cd8-b6fe-30829b440d06 on network e0e08679-82fe-47eb-90b6-49a1713fdaca {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:11:17.376460 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-29e37c2b-9ce6-4a9a-8b64-c77e55a990ee admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:17.386261 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 11, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:11:17.386685 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] Checking segment: {'id': '13aab495-f4c4-414c-b50c-fd22b4e0ef0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 188, 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101247) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:11:17.387087 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:17.387479 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] Bound using segment: {'id': '13aab495-f4c4-414c-b50c-fd22b4e0ef0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 188, 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca'} {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:11:17.389937 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] Bound port: 9e08c20e-219c-4cd8-b6fe-30829b440d06, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '13aab495-f4c4-414c-b50c-fd22b4e0ef0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 188, 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca'}}] {{(pid=101247) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:11:17.390393 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:17.468810 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-29e37c2b-9ce6-4a9a-8b64-c77e55a990ee admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:17.479188 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5487a5af-17d4-4304-93f6-d906dd22726c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:17.527754 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.db [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] For port 9e08c20e-219c-4cd8-b6fe-30829b440d06, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101247) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:11:17.531290 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.db [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] For port 9e08c20e-219c-4cd8-b6fe-30829b440d06, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=9e08c20e-219c-4cd8-b6fe-30829b440d06,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101247) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:11:17.537964 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:17.607948 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63e5fe08-c35d-48a9-9213-b815bbad24d4 None None] Pushing event updated for resources: {'Port': ['ID=9e08c20e-219c-4cd8-b6fe-30829b440d06,revision_number=4']} {{(pid=101247) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:17.628262 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-29e37c2b-9ce6-4a9a-8b64-c77e55a990ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:17.642464 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-29e37c2b-9ce6-4a9a-8b64-c77e55a990ee admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:17.645937 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-29e37c2b-9ce6-4a9a-8b64-c77e55a990ee admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/f0e07a79-4d91-463a-b624-56bb86996784 HTTP/1.1" status: 204 len: 168 time: 0.6922634 Nov 08 16:11:17.656890 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] Routers {'e5087790-dc76-4f18-81a3-548feaf21791'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:11:17.657563 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:11:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['e5087790-dc76-4f18-81a3-548feaf21791'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:11:17.720594 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-a862c9d8-3eb0-4aff-b920-7fd6dcac35b8 None None] Provisioning complete for port 9e08c20e-219c-4cd8-b6fe-30829b440d06 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:17.729013 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-a862c9d8-3eb0-4aff-b920-7fd6dcac35b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:17.802754 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5487a5af-17d4-4304-93f6-d906dd22726c admin admin] Pushing event updated for resources: {'Port': ['ID=30759480-5159-4b6e-a269-86ac7d105870,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:17.803559 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29e37c2b-9ce6-4a9a-8b64-c77e55a990ee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f0e07a79-4d91-463a-b624-56bb86996784,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:17.832026 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] Publish callbacks [] for port, precommit_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:17.840106 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b0b8e072-694f-4a78-bd4c-f7f1c91e4017 req-249665a2-2933-437a-9e89-b1c084ed3c87 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 210 time: 0.5203264 Nov 08 16:11:17.861741 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:17.926698 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1e9178c9-0f2e-4ef0-920a-15217f1a72fc req-b2e36cf8-60b5-4aa3-ba9f-c9858bbd632f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 210 time: 0.3295755 Nov 08 16:11:17.927315 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c842fe4-ab29-4cb1-bd79-3697aeec9e56 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e810c620-4925-4c58-a724-abefd701714b,revision_number=0']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:17.931011 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] Set router e5087790-dc76-4f18-81a3-548feaf21791 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:11:17.970987 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7c842fe4-ab29-4cb1-bd79-3697aeec9e56 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:17.976102 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-7c842fe4-ab29-4cb1-bd79-3697aeec9e56 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.2910819 Nov 08 16:11:17.983593 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59598) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:17.987980 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-91267e4e-3e91-437a-93d5-c629927d7923 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:18.001684 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-a93eb749-1b13-4555-b167-9b3da9f82ccc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Request body: {'floatingip': {'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:18.071780 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5487a5af-17d4-4304-93f6-d906dd22726c admin admin] Network 75fa9c3e-7bfe-490a-9118-221394c29646 is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:11:18.072127 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-91267e4e-3e91-437a-93d5-c629927d7923 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:18.098957 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-a862c9d8-3eb0-4aff-b920-7fd6dcac35b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:18.108572 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a93eb749-1b13-4555-b167-9b3da9f82ccc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for floatingip, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:18.111699 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-5487a5af-17d4-4304-93f6-d906dd22726c admin admin] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:11:18.121361 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5487a5af-17d4-4304-93f6-d906dd22726c admin admin] Received port after_create {{(pid=101245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:11:18.122048 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5487a5af-17d4-4304-93f6-d906dd22726c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-2033204'] for router_interface, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:18.153210 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] Attempting to bind port 08dc39b4-7c2e-4499-b08d-d80c11a6d6ca on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:11:18.154260 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] Attempting to bind port 08dc39b4-7c2e-4499-b08d-d80c11a6d6ca by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:11:18.154776 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] Attempting to bind port 08dc39b4-7c2e-4499-b08d-d80c11a6d6ca on network 68f46265-b42a-49a0-8d57-f9362045cd9b {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:11:18.156997 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bfb835e-5297-40aa-b36b-fffc9b9458ce None None] Pushing event updated for resources: {'Port': ['ID=08dc39b4-7c2e-4499-b08d-d80c11a6d6ca,revision_number=2']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:18.178430 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 11, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:11:18.179942 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] Checking segment: {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:11:18.180499 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:18.181024 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] Bound using segment: {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:11:18.181635 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] Bound port: 08dc39b4-7c2e-4499-b08d-d80c11a6d6ca, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:11:18.182187 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:18.279364 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-a862c9d8-3eb0-4aff-b920-7fd6dcac35b8 None None] For port 9e08c20e-219c-4cd8-b6fe-30829b440d06, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=9e08c20e-219c-4cd8-b6fe-30829b440d06,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:11:18.286201 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-a862c9d8-3eb0-4aff-b920-7fd6dcac35b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:18.371983 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-91267e4e-3e91-437a-93d5-c629927d7923 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=2b4a4e65f9964bbf8e3b490ec1a1d4d0&name=default HTTP/1.1" status: 200 len: 2996 time: 1.6992166 Nov 08 16:11:18.373054 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59602) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:18.399552 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a862c9d8-3eb0-4aff-b920-7fd6dcac35b8 None None] Pushing event updated for resources: {'Port': ['ID=9e08c20e-219c-4cd8-b6fe-30829b440d06,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:18.408322 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91267e4e-3e91-437a-93d5-c629927d7923 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c654543d-f022-4f3d-b3e6-d3e3c9f265f9,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:18.433935 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-c27c1084-1fa5-470a-8d72-0419fb2d49e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Publish callbacks [] for port, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:18.488276 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59606) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:18.525271 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-396c0bed-7cc6-4fb8-b70e-8de52662dc95 None None] Provisioning complete for port 9e08c20e-219c-4cd8-b6fe-30829b440d06 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:18.525696 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-396c0bed-7cc6-4fb8-b70e-8de52662dc95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:18.558901 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] For port 08dc39b4-7c2e-4499-b08d-d80c11a6d6ca, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:11:18.582328 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] For port 08dc39b4-7c2e-4499-b08d-d80c11a6d6ca, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=08dc39b4-7c2e-4499-b08d-d80c11a6d6ca,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:11:18.584171 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-29e9764c-337e-4feb-9933-dac1587331fa admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:18.591326 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:18.594001 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-48d31f79-494a-4895-8ee0-e66083a156c9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks [] for port, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:18.606594 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:11:18.718586 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'name': 'tempest-AttachVolumeShelveTestJSON-1204269590-router', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118'}], 'enable_snat': True}, 'gw_port_id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:01Z', 'updated_at': '2021-11-08T16:11:11Z', 'revision_number': 4, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'gw_port': {'id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:db:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '9e08c20e-219c-4cd8-b6fe-30829b440d06', 'name': '', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'mac_address': 'fa:16:3e:e6:20:51', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:09Z', 'updated_at': '2021-11-08T16:11:17Z', 'revision_number': 4, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'subnets': [{'id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:11:18.779367 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bc803cb-699b-447b-b7b9-828d214a13ec None None] The sync data for ids ['e5087790-dc76-4f18-81a3-548feaf21791'] in dv-cinder-816187-2-iscsi is: [{'id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'name': 'tempest-AttachVolumeShelveTestJSON-1204269590-router', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118'}], 'enable_snat': True}, 'gw_port_id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:01Z', 'updated_at': '2021-11-08T16:11:11Z', 'revision_number': 4, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'gw_port': {'id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:db:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '9e08c20e-219c-4cd8-b6fe-30829b440d06', 'name': '', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'mac_address': 'fa:16:3e:e6:20:51', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:09Z', 'updated_at': '2021-11-08T16:11:17Z', 'revision_number': 4, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'subnets': [{'id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:11:18.799747 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bfb835e-5297-40aa-b36b-fffc9b9458ce None None] Pushing event updated for resources: {'Port': ['ID=08dc39b4-7c2e-4499-b08d-d80c11a6d6ca,revision_number=3']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:18.827273 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] Routers {'cc1c69bc-09ff-4004-b958-600b83b84026'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:11:18.827970 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:11:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['cc1c69bc-09ff-4004-b958-600b83b84026'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:11:18.895456 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-c27c1084-1fa5-470a-8d72-0419fb2d49e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:18.901581 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e2809df5-9064-4983-803a-d50fc78eda13 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:19.020044 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e2809df5-9064-4983-803a-d50fc78eda13 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:19.135489 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 570b0fd6-c5f9-427e-a59a-28c493e0cd78 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:11:19.191313 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-48d31f79-494a-4895-8ee0-e66083a156c9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:19.252898 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-c27c1084-1fa5-470a-8d72-0419fb2d49e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Network 8d351af8-ed05-48f5-939b-8cf227b5c91c is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:11:19.301779 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-c27c1084-1fa5-470a-8d72-0419fb2d49e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:11:19.313940 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a93eb749-1b13-4555-b167-9b3da9f82ccc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:19.353515 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-29e9764c-337e-4feb-9933-dac1587331fa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:19.381777 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b5f4c10-c894-433a-944d-5832cd2c5c8a req-3a581a02-1a01-4ca4-b237-4d66ef39a147 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:19.390403 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2b5f4c10-c894-433a-944d-5832cd2c5c8a req-3a581a02-1a01-4ca4-b237-4d66ef39a147 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 932 time: 0.3382802 Nov 08 16:11:19.401022 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-29e9764c-337e-4feb-9933-dac1587331fa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:19.416443 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-456514b1-7e63-4805-9ed1-b3272e4ed409 req-21901647-19a8-4c49-a541-f1b43b4b6ccc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:19.418811 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-456514b1-7e63-4805-9ed1-b3272e4ed409 req-21901647-19a8-4c49-a541-f1b43b4b6ccc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 931 time: 0.3316700 Nov 08 16:11:19.419977 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5487a5af-17d4-4304-93f6-d906dd22726c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:19.455625 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e2809df5-9064-4983-803a-d50fc78eda13 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:19.458594 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e2809df5-9064-4983-803a-d50fc78eda13 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:19.463492 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-e2809df5-9064-4983-803a-d50fc78eda13 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/c654543d-f022-4f3d-b3e6-d3e3c9f265f9 HTTP/1.1" status: 204 len: 168 time: 1.0879014 Nov 08 16:11:19.477882 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-c27c1084-1fa5-470a-8d72-0419fb2d49e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Received port after_create {{(pid=101245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:11:19.491038 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] Set router cc1c69bc-09ff-4004-b958-600b83b84026 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:11:19.504147 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-c27c1084-1fa5-470a-8d72-0419fb2d49e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:19.505107 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-c27c1084-1fa5-470a-8d72-0419fb2d49e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for port, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:19.582707 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c27c1084-1fa5-470a-8d72-0419fb2d49e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Pushing event updated for resources: {'Port': ['ID=70c72d16-a0e9-49bb-b7b8-ef436d81a390,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:19.702015 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-54269210-91d2-46c9-926e-655939d27187 None None] Provisioning complete for port 30759480-5159-4b6e-a269-86ac7d105870 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:19.704463 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-54269210-91d2-46c9-926e-655939d27187 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:19.728370 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29e9764c-337e-4feb-9933-dac1587331fa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bc5cef10-bf0d-4535-8664-159c2795b8d0,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:19.747238 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-48d31f79-494a-4895-8ee0-e66083a156c9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Network f70ee550-62a6-48db-bca5-a0b964bbcce9 is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:11:19.747941 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-29e9764c-337e-4feb-9933-dac1587331fa admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=df6b18732ea043678c8dc59dc688971d&name=default HTTP/1.1" status: 200 len: 2996 time: 1.2469645 Nov 08 16:11:19.757024 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-c27c1084-1fa5-470a-8d72-0419fb2d49e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 7.1498487 Nov 08 16:11:19.761971 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-48d31f79-494a-4895-8ee0-e66083a156c9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:11:19.770389 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-48d31f79-494a-4895-8ee0-e66083a156c9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Received port after_create {{(pid=101245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:11:19.781456 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-48d31f79-494a-4895-8ee0-e66083a156c9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:19.782078 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-48d31f79-494a-4895-8ee0-e66083a156c9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for port, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:19.795947 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2809df5-9064-4983-803a-d50fc78eda13 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c654543d-f022-4f3d-b3e6-d3e3c9f265f9,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:19.802135 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 59638) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:19.845642 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2b5f4c10-c894-433a-944d-5832cd2c5c8a req-4e089b70-bdd9-4db7-b5bb-6be13071bcb1 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4534419 Nov 08 16:11:19.859779 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-456514b1-7e63-4805-9ed1-b3272e4ed409 req-fab45077-7858-47ff-b964-ef29540ec6b1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3737395 Nov 08 16:11:19.940425 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [None req-a93eb749-1b13-4555-b167-9b3da9f82ccc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Allocated IP 172.27.3.146 (68f46265-b42a-49a0-8d57-f9362045cd9b/4728e4be-5a19-43c0-89cf-ced2a190645d/3d6fe3bf-2ff3-45bc-bd54-49d907904801) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:11:20.022231 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9cc3e600-d303-4586-9588-09211708a1b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:20.052405 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-cee1fa75-f401-4f19-9e45-1c27d81a6476 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] http://10.222.0.37:9696/v2.0/extensions returned with HTTP 200 {{(pid=101245) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 16:11:20.053631 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-cee1fa75-f401-4f19-9e45-1c27d81a6476 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0077109 Nov 08 16:11:20.244907 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a93eb749-1b13-4555-b167-9b3da9f82ccc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:20.256120 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-54269210-91d2-46c9-926e-655939d27187 None None] Port 30759480-5159-4b6e-a269-86ac7d105870 cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:11:20.256744 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-48d31f79-494a-4895-8ee0-e66083a156c9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 5.8910501 Nov 08 16:11:20.295537 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48d31f79-494a-4895-8ee0-e66083a156c9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Pushing event updated for resources: {'Port': ['ID=4020a644-ef2e-4dd8-931a-cfccef4e7b15,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:20.366250 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a93eb749-1b13-4555-b167-9b3da9f82ccc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:20.389886 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 570b0fd6-c5f9-427e-a59a-28c493e0cd78 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:20.393111 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:20.450115 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a93eb749-1b13-4555-b167-9b3da9f82ccc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Network 68f46265-b42a-49a0-8d57-f9362045cd9b is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:11:20.454726 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-a93eb749-1b13-4555-b167-9b3da9f82ccc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:11:20.457353 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a93eb749-1b13-4555-b167-9b3da9f82ccc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:11:20.464291 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a93eb749-1b13-4555-b167-9b3da9f82ccc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Pushing event updated for resources: {'Port': ['ID=3d6fe3bf-2ff3-45bc-bd54-49d907904801,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:20.468738 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5487a5af-17d4-4304-93f6-d906dd22726c admin admin] Publish callbacks [] for port, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:20.537823 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5487a5af-17d4-4304-93f6-d906dd22726c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:20.539118 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5487a5af-17d4-4304-93f6-d906dd22726c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1599525', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-2033312'] for router_interface, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:20.552216 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc1c69bc-09ff-4004-b958-600b83b84026', 'name': 'tempest-ServerRescueNegativeTestJSON-593854580-router', 'tenant_id': '4818358a827143eb9ace58a26713cdf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.169'}], 'enable_snat': True}, 'gw_port_id': '08dc39b4-7c2e-4499-b08d-d80c11a6d6ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:09Z', 'revision_number': 3, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'gw_port': {'id': '08dc39b4-7c2e-4499-b08d-d80c11a6d6ca', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:2d:58:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc1c69bc-09ff-4004-b958-600b83b84026', 'device_owner': 'network:router_gateway', 'standard_attr_id': 98, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:08Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:11:20.562401 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-75f5f174-c1a7-482f-8269-f3c90fff96da admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:20.628558 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e67e38f7-6ad2-451c-94db-19d3e7f041ff None None] The sync data for ids ['cc1c69bc-09ff-4004-b958-600b83b84026'] in dv-cinder-816187-2-iscsi is: [{'id': 'cc1c69bc-09ff-4004-b958-600b83b84026', 'name': 'tempest-ServerRescueNegativeTestJSON-593854580-router', 'tenant_id': '4818358a827143eb9ace58a26713cdf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.169'}], 'enable_snat': True}, 'gw_port_id': '08dc39b4-7c2e-4499-b08d-d80c11a6d6ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:09Z', 'revision_number': 3, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'gw_port': {'id': '08dc39b4-7c2e-4499-b08d-d80c11a6d6ca', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:2d:58:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc1c69bc-09ff-4004-b958-600b83b84026', 'device_owner': 'network:router_gateway', 'standard_attr_id': 98, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:08Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:11:20.647350 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a93eb749-1b13-4555-b167-9b3da9f82ccc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:20.668202 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-fae545b8-892c-4513-9400-df0fe337ab0f service neutron] Request body: {'port': {'device_id': 'ec4f96b9-4128-4da6-9880-95a0f72fd4e2', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81618'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:20.729564 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:20.734614 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-932935f2-b36c-4816-bdfe-8714cd8d8025 service neutron] Request body: {'port': {'device_id': 'dfa35d29-db7d-4fab-a001-7db0d508d70a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81618'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:20.742509 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a93eb749-1b13-4555-b167-9b3da9f82ccc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:20.786050 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] For port 570b0fd6-c5f9-427e-a59a-28c493e0cd78, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=570b0fd6-c5f9-427e-a59a-28c493e0cd78,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:11:20.793023 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:20.936564 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Pushing event updated for resources: {'Port': ['ID=570b0fd6-c5f9-427e-a59a-28c493e0cd78,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:20.961582 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_common [None req-9cc3e600-d303-4586-9588-09211708a1b5 admin admin] Allocated IP 172.20.0.1 (2d5b5768-37f3-49a1-b451-2803f6f97429/6936707c-bd3f-4cd8-9462-a4af0ea16ed8/8c0c4f72-e955-4eba-bada-1276c931cd7f) {{(pid=101245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:11:21.011822 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-75f5f174-c1a7-482f-8269-f3c90fff96da admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:21.068475 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 9e08c20e-219c-4cd8-b6fe-30829b440d06 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:11:21.227557 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 9e08c20e-219c-4cd8-b6fe-30829b440d06 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:21.231047 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:21.558934 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5487a5af-17d4-4304-93f6-d906dd22726c admin admin] Pushing event updated for resources: {'Port': ['ID=30759480-5159-4b6e-a269-86ac7d105870,revision_number=2']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:21.643561 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a93eb749-1b13-4555-b167-9b3da9f82ccc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:21.654223 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-932935f2-b36c-4816-bdfe-8714cd8d8025 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:21.657556 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a93eb749-1b13-4555-b167-9b3da9f82ccc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:21.763480 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-75f5f174-c1a7-482f-8269-f3c90fff96da admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:21.766054 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-75f5f174-c1a7-482f-8269-f3c90fff96da admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:21.766759 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a93eb749-1b13-4555-b167-9b3da9f82ccc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-2032271'] for floatingip, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:21.771078 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-75f5f174-c1a7-482f-8269-f3c90fff96da admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/bc5cef10-bf0d-4535-8664-159c2795b8d0 HTTP/1.1" status: 204 len: 168 time: 1.7549829 Nov 08 16:11:21.839270 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59682) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:21.891563 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5a689b9-ab38-4d0b-8c77-ab98e67030c5 req-eae449e9-4e60-46e5-87fa-2f736b6bfb0d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:21.900686 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75f5f174-c1a7-482f-8269-f3c90fff96da admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bc5cef10-bf0d-4535-8664-159c2795b8d0,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:21.903707 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c5a689b9-ab38-4d0b-8c77-ab98e67030c5 req-eae449e9-4e60-46e5-87fa-2f736b6bfb0d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 931 time: 0.8009503 Nov 08 16:11:21.934032 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a93eb749-1b13-4555-b167-9b3da9f82ccc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for floatingip, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:21.935441 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-a93eb749-1b13-4555-b167-9b3da9f82ccc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 3.9428432 Nov 08 16:11:21.973401 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d6629a4-0be0-43ad-a785-20be29e4eecc req-2ddb6d44-7358-4974-9020-af3416204889 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:21.982229 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7d6629a4-0be0-43ad-a785-20be29e4eecc req-2ddb6d44-7358-4974-9020-af3416204889 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 932 time: 0.9039927 Nov 08 16:11:21.983535 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a93eb749-1b13-4555-b167-9b3da9f82ccc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Pushing event updated for resources: {'Port': ['ID=3d6fe3bf-2ff3-45bc-bd54-49d907904801,revision_number=2']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:22.146071 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c5a689b9-ab38-4d0b-8c77-ab98e67030c5 req-33acf68e-c5fb-4039-bb76-70d3a4cc6f68 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2413390 Nov 08 16:11:22.160386 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7d6629a4-0be0-43ad-a785-20be29e4eecc req-6fa97148-4259-4a4f-b102-b162dd1d6d0d tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1674814 Nov 08 16:11:22.189614 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-fae545b8-892c-4513-9400-df0fe337ab0f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:22.456763 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5487a5af-17d4-4304-93f6-d906dd22726c admin admin] Network 75fa9c3e-7bfe-490a-9118-221394c29646 is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:11:22.482479 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-5487a5af-17d4-4304-93f6-d906dd22726c admin admin] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:11:22.542806 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9cc3e600-d303-4586-9588-09211708a1b5 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:22.604847 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-01a72241-3c5a-4964-b802-4f66d582604a admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:22.654014 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-0b6e9226-031b-4c8e-a5c1-6e0cc4ffa2cc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?name=tempest-securitygroup--1194879682&fields=id&tenant_id=10a4252a63bf480d93d2e9da15bb8efd HTTP/1.1" status: 200 len: 267 time: 0.1874776 Nov 08 16:11:22.868245 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-01a72241-3c5a-4964-b802-4f66d582604a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:22.885443 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-01a72241-3c5a-4964-b802-4f66d582604a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:22.925309 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-01a72241-3c5a-4964-b802-4f66d582604a admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=1c790612ef094e5d84f1a4c1137b2857&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0829926 Nov 08 16:11:22.928384 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59716) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:23.154573 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01a72241-3c5a-4964-b802-4f66d582604a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8513d8ad-e1d8-4115-9165-0ee5c98e809c,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:23.158255 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 08dc39b4-7c2e-4499-b08d-d80c11a6d6ca up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:11:23.178930 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-dff21fa9-2f15-4f49-9750-431ae408fc78 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:23.196812 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-dff21fa9-2f15-4f49-9750-431ae408fc78 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/networks?id=e0e08679-82fe-47eb-90b6-49a1713fdaca HTTP/1.1" status: 200 len: 817 time: 0.5417800 Nov 08 16:11:23.280155 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-d287cbc8-b8a3-4538-aa9b-a0bb4f356cd8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/quotas/10a4252a63bf480d93d2e9da15bb8efd HTTP/1.1" status: 200 len: 375 time: 0.0590153 Nov 08 16:11:23.285561 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a5fd14c4-c6b1-44cc-9586-733487438983 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:23.349187 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 08dc39b4-7c2e-4499-b08d-d80c11a6d6ca triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:23.349594 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:23.440928 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.notifiers.nova [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-932935f2-b36c-4816-bdfe-8714cd8d8025 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4020a644-ef2e-4dd8-931a-cfccef4e7b15 {{(pid=101245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:11:23.466044 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a5fd14c4-c6b1-44cc-9586-733487438983 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:23.487020 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:23.504805 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-932935f2-b36c-4816-bdfe-8714cd8d8025 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:23.537904 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] For port 08dc39b4-7c2e-4499-b08d-d80c11a6d6ca, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=08dc39b4-7c2e-4499-b08d-d80c11a6d6ca,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:11:23.542077 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-df43be68-f9e0-45c8-b341-922eb91fb1c8 None None] Provisioning complete for port 30759480-5159-4b6e-a269-86ac7d105870 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:23.542494 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-df43be68-f9e0-45c8-b341-922eb91fb1c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:23.559633 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-4247e01b-0dee-4342-ad90-a3e855466b7d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?tenant_id=10a4252a63bf480d93d2e9da15bb8efd&fields=id HTTP/1.1" status: 200 len: 348 time: 0.2782979 Nov 08 16:11:23.591352 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.provisioning_blocks [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-932935f2-b36c-4816-bdfe-8714cd8d8025 service neutron] Transition to ACTIVE for port object 4020a644-ef2e-4dd8-931a-cfccef4e7b15 will not be triggered until provisioned by entity L2. {{(pid=101245) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 16:11:23.608081 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-df43be68-f9e0-45c8-b341-922eb91fb1c8 None None] Port 30759480-5159-4b6e-a269-86ac7d105870 cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:11:23.628577 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:23.631490 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 570b0fd6-c5f9-427e-a59a-28c493e0cd78 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:11:23.650503 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11289e79-0006-4048-9faa-20e5432f21d7 req-1200d4a2-1426-435f-9975-323e8ee03bbe tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:23.654343 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-11289e79-0006-4048-9faa-20e5432f21d7 req-1200d4a2-1426-435f-9975-323e8ee03bbe tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 931 time: 0.3486819 Nov 08 16:11:23.735808 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-932935f2-b36c-4816-bdfe-8714cd8d8025 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:23.762386 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5487a5af-17d4-4304-93f6-d906dd22726c admin admin] Router c3f55c44-bed1-4955-9229-dac3c412f010 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101245) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:11:23.832888 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Pushing event updated for resources: {'Port': ['ID=08dc39b4-7c2e-4499-b08d-d80c11a6d6ca,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:23.856126 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 570b0fd6-c5f9-427e-a59a-28c493e0cd78 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:23.856742 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:23.957434 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-11289e79-0006-4048-9faa-20e5432f21d7 req-064ffd18-6991-46e3-b232-77ac1a3859d6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2337942 Nov 08 16:11:23.960690 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a5fd14c4-c6b1-44cc-9586-733487438983 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:23.964080 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a5fd14c4-c6b1-44cc-9586-733487438983 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:23.969430 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-a5fd14c4-c6b1-44cc-9586-733487438983 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/8513d8ad-e1d8-4115-9165-0ee5c98e809c HTTP/1.1" status: 204 len: 168 time: 1.0360672 Nov 08 16:11:23.983308 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5fd14c4-c6b1-44cc-9586-733487438983 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8513d8ad-e1d8-4115-9165-0ee5c98e809c,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:24.016717 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-26f61856-fe95-4c5f-b4bb-780b85ca050a service neutron] 10.222.0.37 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4374504 Nov 08 16:11:24.031327 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9cc3e600-d303-4586-9588-09211708a1b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:24.177727 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-dd07f428-9897-435b-92ee-4eafb6b14d6e service neutron] 10.222.0.37 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1597822 Nov 08 16:11:24.198411 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.managers [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-932935f2-b36c-4816-bdfe-8714cd8d8025 service neutron] Attempting to bind port 4020a644-ef2e-4dd8-931a-cfccef4e7b15 on host hv-cinder-81618 for vnic_type normal with profile {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:11:24.198765 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.managers [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-932935f2-b36c-4816-bdfe-8714cd8d8025 service neutron] Attempting to bind port 4020a644-ef2e-4dd8-931a-cfccef4e7b15 by drivers openvswitch,hyperv on host hv-cinder-81618 at level 0 using segments [{'id': 'fab7ad78-c438-48e7-8fdb-80ff50b8600c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9'}] {{(pid=101245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:11:24.199122 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-932935f2-b36c-4816-bdfe-8714cd8d8025 service neutron] Attempting to bind port 4020a644-ef2e-4dd8-931a-cfccef4e7b15 on network f70ee550-62a6-48db-bca5-a0b964bbcce9 {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:11:24.203584 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9cc3e600-d303-4586-9588-09211708a1b5 admin admin] Network 2d5b5768-37f3-49a1-b451-2803f6f97429 is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:11:24.213097 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-932935f2-b36c-4816-bdfe-8714cd8d8025 service neutron] Pushing event updated for resources: {'Port': ['ID=4020a644-ef2e-4dd8-931a-cfccef4e7b15,revision_number=2']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:24.229789 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-9cc3e600-d303-4586-9588-09211708a1b5 admin admin] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:11:24.331439 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-932935f2-b36c-4816-bdfe-8714cd8d8025 service neutron] Port 4020a644-ef2e-4dd8-931a-cfccef4e7b15 on network f70ee550-62a6-48db-bca5-a0b964bbcce9 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81618 {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 16:11:24.333679 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-932935f2-b36c-4816-bdfe-8714cd8d8025 service neutron] Attempting to bind port 4020a644-ef2e-4dd8-931a-cfccef4e7b15 on network f70ee550-62a6-48db-bca5-a0b964bbcce9 {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:11:24.345695 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3e624a9-a208-44c8-8633-bbf09e4cec45 req-1ee17481-957c-4368-ac79-018cfd5d726e tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:24.378345 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d3e624a9-a208-44c8-8633-bbf09e4cec45 req-1ee17481-957c-4368-ac79-018cfd5d726e tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 932 time: 0.1968167 Nov 08 16:11:24.384722 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9cc3e600-d303-4586-9588-09211708a1b5 admin admin] Received port after_create {{(pid=101245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:11:24.385269 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9cc3e600-d303-4586-9588-09211708a1b5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-2033204'] for router_interface, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:24.549777 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d3e624a9-a208-44c8-8633-bbf09e4cec45 req-3510906b-88f2-4640-aa97-3e54dcdaad60 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1525264 Nov 08 16:11:24.584104 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-932935f2-b36c-4816-bdfe-8714cd8d8025 service neutron] Checking agent: {'id': '54bf9779-c14d-412a-90fc-96b4a6589d5a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81618', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'started_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 11, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:11:24.585230 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-932935f2-b36c-4816-bdfe-8714cd8d8025 service neutron] Checking segment: {'id': 'fab7ad78-c438-48e7-8fdb-80ff50b8600c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:11:24.587284 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-932935f2-b36c-4816-bdfe-8714cd8d8025 service neutron] Bound using segment: {'id': 'fab7ad78-c438-48e7-8fdb-80ff50b8600c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9'} {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:11:24.588385 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.managers [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-932935f2-b36c-4816-bdfe-8714cd8d8025 service neutron] Bound port: 4020a644-ef2e-4dd8-931a-cfccef4e7b15, host: hv-cinder-81618, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fab7ad78-c438-48e7-8fdb-80ff50b8600c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9'}}] {{(pid=101245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:11:24.589582 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-932935f2-b36c-4816-bdfe-8714cd8d8025 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:24.665459 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4da67140-d7aa-4f9f-8d3c-b8e5a661f3b5 req-2af80326-0e1e-4e0e-8c4d-caafcf0550e5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 210 time: 0.0778787 Nov 08 16:11:24.755420 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cc3e600-d303-4586-9588-09211708a1b5 admin admin] Pushing event updated for resources: {'Port': ['ID=8c0c4f72-e955-4eba-bada-1276c931cd7f,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:24.966985 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 08dc39b4-7c2e-4499-b08d-d80c11a6d6ca up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:11:24.987061 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.notifiers.nova [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-fae545b8-892c-4513-9400-df0fe337ab0f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 70c72d16-a0e9-49bb-b7b8-ef436d81a390 {{(pid=101245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:11:25.077950 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-fae545b8-892c-4513-9400-df0fe337ab0f service neutron] Publish callbacks [] for port, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:25.114102 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5487a5af-17d4-4304-93f6-d906dd22726c admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101245) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:11:25.142618 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] Sync routers for ids ['c3f55c44-bed1-4955-9229-dac3c412f010'] in dv-cinder-816187-2-iscsi {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:11:25.157491 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] Routers {'c3f55c44-bed1-4955-9229-dac3c412f010'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:11:25.159243 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:11:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['c3f55c44-bed1-4955-9229-dac3c412f010'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:11:25.165483 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 08dc39b4-7c2e-4499-b08d-d80c11a6d6ca triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:25.165885 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:25.199503 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-932935f2-b36c-4816-bdfe-8714cd8d8025 service neutron] For port 4020a644-ef2e-4dd8-931a-cfccef4e7b15, host hv-cinder-81618, cleared binding levels {{(pid=101245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:11:25.214127 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-932935f2-b36c-4816-bdfe-8714cd8d8025 service neutron] For port 4020a644-ef2e-4dd8-931a-cfccef4e7b15, host hv-cinder-81618, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=4020a644-ef2e-4dd8-931a-cfccef4e7b15,segment=NetworkSegment(fab7ad78-c438-48e7-8fdb-80ff50b8600c),segment_id=fab7ad78-c438-48e7-8fdb-80ff50b8600c)] {{(pid=101245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:11:25.232177 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-5487a5af-17d4-4304-93f6-d906dd22726c admin admin] 10.222.0.37 "PUT /v2.0/routers/c3f55c44-bed1-4955-9229-dac3c412f010/add_router_interface HTTP/1.1" status: 200 len: 503 time: 15.1317124 Nov 08 16:11:25.234713 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5995145-a46d-44d3-ae43-68f6debc5943 req-50a9cf5f-5d77-468b-8030-eb9195ec9fff tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:25.238680 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a5995145-a46d-44d3-ae43-68f6debc5943 req-50a9cf5f-5d77-468b-8030-eb9195ec9fff tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 943 time: 0.1109548 Nov 08 16:11:25.265963 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59772) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:25.286166 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-932935f2-b36c-4816-bdfe-8714cd8d8025 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:25.293027 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.provisioning_blocks [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-fae545b8-892c-4513-9400-df0fe337ab0f service neutron] Transition to ACTIVE for port object 70c72d16-a0e9-49bb-b7b8-ef436d81a390 will not be triggered until provisioned by entity L2. {{(pid=101245) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 16:11:25.356741 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a5995145-a46d-44d3-ae43-68f6debc5943 req-0851388c-7c6b-4bfa-9b8d-e5b8b50cdc95 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1007147 Nov 08 16:11:25.362951 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-fae545b8-892c-4513-9400-df0fe337ab0f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:25.416199 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-932935f2-b36c-4816-bdfe-8714cd8d8025 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:25.417168 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-932935f2-b36c-4816-bdfe-8714cd8d8025 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for port, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:25.418869 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-932935f2-b36c-4816-bdfe-8714cd8d8025 service neutron] 10.222.0.25 "PUT /v2.0/ports/4020a644-ef2e-4dd8-931a-cfccef4e7b15 HTTP/1.1" status: 200 len: 1093 time: 4.9741602 Nov 08 16:11:25.419799 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dfa35d29-db7d-4fab-a001-7db0d508d70a', 'tag': '4020a644-ef2e-4dd8-931a-cfccef4e7b15'}] {{(pid=101245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:11:25.622418 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9cc3e600-d303-4586-9588-09211708a1b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:25.628884 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] Set router c3f55c44-bed1-4955-9229-dac3c412f010 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:11:25.645932 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-932935f2-b36c-4816-bdfe-8714cd8d8025 service neutron] Pushing event updated for resources: {'Port': ['ID=4020a644-ef2e-4dd8-931a-cfccef4e7b15,revision_number=3']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:25.833822 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-461038a8-a37c-44b2-a77e-5ba4dd6a1b5f admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:25.927805 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb2f526e-8f51-4d7a-b0bd-41444e9037dc req-51a82e38-e0c8-4f70-8c77-a1cbc2524fd1 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:25.929316 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fb2f526e-8f51-4d7a-b0bd-41444e9037dc req-51a82e38-e0c8-4f70-8c77-a1cbc2524fd1 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 944 time: 0.1597369 Nov 08 16:11:26.072209 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fb2f526e-8f51-4d7a-b0bd-41444e9037dc req-100375d4-11a1-466e-8fc4-a49474db624b tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1282945 Nov 08 16:11:26.097096 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fae545b8-892c-4513-9400-df0fe337ab0f service neutron] Pushing event updated for resources: {'Port': ['ID=70c72d16-a0e9-49bb-b7b8-ef436d81a390,revision_number=2']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:26.128169 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.managers [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-fae545b8-892c-4513-9400-df0fe337ab0f service neutron] Attempting to bind port 70c72d16-a0e9-49bb-b7b8-ef436d81a390 on host hv-cinder-81618 for vnic_type normal with profile {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:11:26.132100 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.managers [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-fae545b8-892c-4513-9400-df0fe337ab0f service neutron] Attempting to bind port 70c72d16-a0e9-49bb-b7b8-ef436d81a390 by drivers openvswitch,hyperv on host hv-cinder-81618 at level 0 using segments [{'id': '297c0462-3903-48e7-a4ef-95b52eec7b18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '8d351af8-ed05-48f5-939b-8cf227b5c91c'}] {{(pid=101245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:11:26.132100 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-fae545b8-892c-4513-9400-df0fe337ab0f service neutron] Attempting to bind port 70c72d16-a0e9-49bb-b7b8-ef436d81a390 on network 8d351af8-ed05-48f5-939b-8cf227b5c91c {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:11:26.149287 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-ac3a84d5-3ac9-470d-9aa4-4e3e5bc1f6d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:26.150869 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-ac3a84d5-3ac9-470d-9aa4-4e3e5bc1f6d8 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=549e9715f7424ff5b3b252f354adafe9&device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 1096 time: 0.6188078 Nov 08 16:11:26.160285 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-fae545b8-892c-4513-9400-df0fe337ab0f service neutron] Port 70c72d16-a0e9-49bb-b7b8-ef436d81a390 on network 8d351af8-ed05-48f5-939b-8cf227b5c91c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81618 {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 16:11:26.160619 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-fae545b8-892c-4513-9400-df0fe337ab0f service neutron] Attempting to bind port 70c72d16-a0e9-49bb-b7b8-ef436d81a390 on network 8d351af8-ed05-48f5-939b-8cf227b5c91c {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:11:26.173032 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-fae545b8-892c-4513-9400-df0fe337ab0f service neutron] Checking agent: {'id': '54bf9779-c14d-412a-90fc-96b4a6589d5a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81618', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'started_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 11, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:11:26.173352 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-fae545b8-892c-4513-9400-df0fe337ab0f service neutron] Checking segment: {'id': '297c0462-3903-48e7-a4ef-95b52eec7b18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '8d351af8-ed05-48f5-939b-8cf227b5c91c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:11:26.174215 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-fae545b8-892c-4513-9400-df0fe337ab0f service neutron] Bound using segment: {'id': '297c0462-3903-48e7-a4ef-95b52eec7b18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '8d351af8-ed05-48f5-939b-8cf227b5c91c'} {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:11:26.174661 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.managers [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-fae545b8-892c-4513-9400-df0fe337ab0f service neutron] Bound port: 70c72d16-a0e9-49bb-b7b8-ef436d81a390, host: hv-cinder-81618, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '297c0462-3903-48e7-a4ef-95b52eec7b18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '8d351af8-ed05-48f5-939b-8cf227b5c91c'}}] {{(pid=101245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:11:26.175011 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-fae545b8-892c-4513-9400-df0fe337ab0f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:26.177423 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-461038a8-a37c-44b2-a77e-5ba4dd6a1b5f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:26.184372 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-461038a8-a37c-44b2-a77e-5ba4dd6a1b5f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:26.236661 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-461038a8-a37c-44b2-a77e-5ba4dd6a1b5f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3bcc5fc4-3684-427e-8037-c54f341df0d8,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:26.243620 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-461038a8-a37c-44b2-a77e-5ba4dd6a1b5f admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=2771972dffb54d99bd6e9dc6497e700a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9762025 Nov 08 16:11:26.268737 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59802) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:26.325008 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'name': 'tempest-AttachVolumeTestJSON-272347721-router', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128'}], 'enable_snat': True}, 'gw_port_id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 4, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'gw_port': {'id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:97:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '30759480-5159-4b6e-a269-86ac7d105870', 'name': '', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'mac_address': 'fa:16:3e:86:ee:77', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:13Z', 'updated_at': '2021-11-08T16:11:19Z', 'revision_number': 2, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'subnets': [{'id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:11:26.384529 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-8f4f0acc-5fa3-400d-afb2-e44f92a03b31 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4020a644-ef2e-4dd8-931a-cfccef4e7b15 HTTP/1.1" status: 200 len: 217 time: 0.2066150 Nov 08 16:11:26.396824 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] Checking router: c3f55c44-bed1-4955-9229-dac3c412f010 for host: dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:11:26.397192 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] Updating router c3f55c44-bed1-4955-9229-dac3c412f010 port 30759480-5159-4b6e-a269-86ac7d105870 binding host dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 16:11:26.420058 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8dfc4853-26d9-4689-bc72-74fe3e3e5f45 req-3497f2d0-4b55-4648-a87c-366297e57d10 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 210 time: 0.1490242 Nov 08 16:11:26.457586 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-fae545b8-892c-4513-9400-df0fe337ab0f service neutron] For port 70c72d16-a0e9-49bb-b7b8-ef436d81a390, host hv-cinder-81618, cleared binding levels {{(pid=101245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:11:26.470152 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-fae545b8-892c-4513-9400-df0fe337ab0f service neutron] For port 70c72d16-a0e9-49bb-b7b8-ef436d81a390, host hv-cinder-81618, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=70c72d16-a0e9-49bb-b7b8-ef436d81a390,segment=NetworkSegment(297c0462-3903-48e7-a4ef-95b52eec7b18),segment_id=297c0462-3903-48e7-a4ef-95b52eec7b18)] {{(pid=101245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:11:26.473501 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9303bddee447de525cefc409d3d14f9dbe8ef1f21bfe9eb24fdef2609d4aa3c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bb6f6f67-d66a-4a6b-b7a7-47c4d960016d" -d '{"events": [{"name": "network-changed", "server_uuid": "dfa35d29-db7d-4fab-a001-7db0d508d70a", "tag": "4020a644-ef2e-4dd8-931a-cfccef4e7b15"}]}' {{(pid=101245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:11:26.477077 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:26.484520 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9cf3de5e-c152-4ee8-985c-7eb47f3793fe admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:26.516846 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-fae545b8-892c-4513-9400-df0fe337ab0f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:26.559079 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9cf3de5e-c152-4ee8-985c-7eb47f3793fe admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:26.577610 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-fae545b8-892c-4513-9400-df0fe337ab0f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:26.578250 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-fae545b8-892c-4513-9400-df0fe337ab0f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for port, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:26.579718 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-fae545b8-892c-4513-9400-df0fe337ab0f service neutron] 10.222.0.25 "PUT /v2.0/ports/70c72d16-a0e9-49bb-b7b8-ef436d81a390 HTTP/1.1" status: 200 len: 1094 time: 6.1361852 Nov 08 16:11:26.622926 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-e345bd8b-bced-477b-832a-8c75ac62b04d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:26.624655 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-e345bd8b-bced-477b-832a-8c75ac62b04d service neutron] 10.222.0.25 "GET /v2.0/subnets?id=cd23e532-b366-42a0-82e4-ec7326cf3b48 HTTP/1.1" status: 200 len: 855 time: 0.2226481 Nov 08 16:11:26.646892 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fae545b8-892c-4513-9400-df0fe337ab0f service neutron] Pushing event updated for resources: {'Port': ['ID=70c72d16-a0e9-49bb-b7b8-ef436d81a390,revision_number=3']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:26.681028 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e83102d-ebd7-4913-b0d9-5f173dfad58d req-caf04bbf-3223-49b8-a1a8-439be7e7e22c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:26.683056 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7e83102d-ebd7-4913-b0d9-5f173dfad58d req-caf04bbf-3223-49b8-a1a8-439be7e7e22c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 943 time: 0.1353490 Nov 08 16:11:26.717695 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9cc3e600-d303-4586-9588-09211708a1b5 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:26.729636 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9cc3e600-d303-4586-9588-09211708a1b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:26.730391 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9cc3e600-d303-4586-9588-09211708a1b5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1599525', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-2033312'] for router_interface, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:26.742526 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7e83102d-ebd7-4913-b0d9-5f173dfad58d req-76bf9a23-0b00-47b2-a117-7f0cfc864625 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0531030 Nov 08 16:11:26.743581 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9cf3de5e-c152-4ee8-985c-7eb47f3793fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:26.747317 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9cf3de5e-c152-4ee8-985c-7eb47f3793fe admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:26.748556 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-9cf3de5e-c152-4ee8-985c-7eb47f3793fe admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/3bcc5fc4-3684-427e-8037-c54f341df0d8 HTTP/1.1" status: 204 len: 168 time: 0.4763520 Nov 08 16:11:26.758951 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cf3de5e-c152-4ee8-985c-7eb47f3793fe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3bcc5fc4-3684-427e-8037-c54f341df0d8,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:26.846913 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59826) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:26.853378 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-633ec12d-fa89-442d-ad87-d3ff36680472 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Request body: {'security_group': {'name': 'tempest-securitygroup--843466784', 'description': 'tempest-description--91625135'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:26.884996 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-633ec12d-fa89-442d-ad87-d3ff36680472 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:26.983155 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] Publish callbacks [] for port, precommit_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:26.991965 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:27.003359 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9cc3e600-d303-4586-9588-09211708a1b5 admin admin] Network 2d5b5768-37f3-49a1-b451-2803f6f97429 is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:11:27.004594 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cc3e600-d303-4586-9588-09211708a1b5 admin admin] Pushing event updated for resources: {'Port': ['ID=8c0c4f72-e955-4eba-bada-1276c931cd7f,revision_number=2']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:27.011350 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-9cc3e600-d303-4586-9588-09211708a1b5 admin admin] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:11:27.028489 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-633ec12d-fa89-442d-ad87-d3ff36680472 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:27.039910 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-633ec12d-fa89-442d-ad87-d3ff36680472 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:27.045757 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33dd232a-a4d0-46ea-aa12-e65a29e3c64b None None] Pushing event updated for resources: {'Port': ['ID=30759480-5159-4b6e-a269-86ac7d105870,revision_number=3']} {{(pid=101247) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:27.118054 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] Attempting to bind port 30759480-5159-4b6e-a269-86ac7d105870 on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:11:27.118427 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] Attempting to bind port 30759480-5159-4b6e-a269-86ac7d105870 by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': '7651dfae-d245-4d32-b379-dc243d043404', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646'}] {{(pid=101247) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:11:27.118784 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] Attempting to bind port 30759480-5159-4b6e-a269-86ac7d105870 on network 75fa9c3e-7bfe-490a-9118-221394c29646 {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:11:27.125904 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 11, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:11:27.126271 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] Checking segment: {'id': '7651dfae-d245-4d32-b379-dc243d043404', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101247) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:11:27.126672 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:27.127247 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] Bound using segment: {'id': '7651dfae-d245-4d32-b379-dc243d043404', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646'} {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:11:27.127727 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] Bound port: 30759480-5159-4b6e-a269-86ac7d105870, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7651dfae-d245-4d32-b379-dc243d043404', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646'}}] {{(pid=101247) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:11:27.128177 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:27.164953 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-633ec12d-fa89-442d-ad87-d3ff36680472 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:27.178132 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-633ec12d-fa89-442d-ad87-d3ff36680472 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.3293083 Nov 08 16:11:27.188010 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59834) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:27.193188 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-bbed6694-eb72-4bbb-b233-14f8d38834b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Request body: {'security_group_rule': {'security_group_id': '293f120d-5959-4f89-b76d-0686f8c34d36', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:27.204311 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-633ec12d-fa89-442d-ad87-d3ff36680472 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Pushing event updated for resources: {'SecurityGroup': ['ID=293f120d-5959-4f89-b76d-0686f8c34d36,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:27.283206 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.db [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] For port 30759480-5159-4b6e-a269-86ac7d105870, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101247) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:11:27.289685 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.db [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] For port 30759480-5159-4b6e-a269-86ac7d105870, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=30759480-5159-4b6e-a269-86ac7d105870,segment=NetworkSegment(7651dfae-d245-4d32-b379-dc243d043404),segment_id=7651dfae-d245-4d32-b379-dc243d043404)] {{(pid=101247) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:11:27.301041 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:27.330705 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94a03a05-a847-4065-a784-088396e9ec25 req-70ec38ea-948d-478b-959f-f70603a0f686 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:27.341837 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9cc3e600-d303-4586-9588-09211708a1b5 admin admin] Router cc1c69bc-09ff-4004-b958-600b83b84026 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101245) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:11:27.354637 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-94a03a05-a847-4065-a784-088396e9ec25 req-70ec38ea-948d-478b-959f-f70603a0f686 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 944 time: 0.1364727 Nov 08 16:11:27.362405 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-bbed6694-eb72-4bbb-b233-14f8d38834b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:27.389731 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] Routers {'c3f55c44-bed1-4955-9229-dac3c412f010'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:11:27.391162 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:11:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['c3f55c44-bed1-4955-9229-dac3c412f010'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:11:27.510789 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33dd232a-a4d0-46ea-aa12-e65a29e3c64b None None] Pushing event updated for resources: {'Port': ['ID=30759480-5159-4b6e-a269-86ac7d105870,revision_number=4']} {{(pid=101247) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:27.530749 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:11:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7c6100f2-8b63-4d66-8cf1-170abb069769 x-openstack-request-id: req-7c6100f2-8b63-4d66-8cf1-170abb069769 {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:11:27.531071 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dfa35d29-db7d-4fab-a001-7db0d508d70a", "tag": "4020a644-ef2e-4dd8-931a-cfccef4e7b15", "status": "completed", "code": 200}]} {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:11:27.531329 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-7c6100f2-8b63-4d66-8cf1-170abb069769 {{(pid=101245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:11:27.531807 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dfa35d29-db7d-4fab-a001-7db0d508d70a', 'tag': '4020a644-ef2e-4dd8-931a-cfccef4e7b15', 'status': 'completed', 'code': 200} Nov 08 16:11:27.586080 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-229c154e-0996-44dc-8bbe-9bd9c42718db None None] Provisioning complete for port 30759480-5159-4b6e-a269-86ac7d105870 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:27.587709 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-229c154e-0996-44dc-8bbe-9bd9c42718db None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:27.667122 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9cc3e600-d303-4586-9588-09211708a1b5 admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101245) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:11:27.674206 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-94a03a05-a847-4065-a784-088396e9ec25 req-328ecda0-12c1-482b-8e20-c3256041a80c tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2660091 Nov 08 16:11:27.683377 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-bbed6694-eb72-4bbb-b233-14f8d38834b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:27.709497 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] Sync routers for ids ['cc1c69bc-09ff-4004-b958-600b83b84026'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:11:27.711250 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-9cc3e600-d303-4586-9588-09211708a1b5 admin admin] 10.222.0.37 "PUT /v2.0/routers/cc1c69bc-09ff-4004-b958-600b83b84026/add_router_interface HTTP/1.1" status: 200 len: 503 time: 12.4404976 Nov 08 16:11:27.729692 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-bbed6694-eb72-4bbb-b233-14f8d38834b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:27.825966 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] Routers {'cc1c69bc-09ff-4004-b958-600b83b84026'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:11:27.827901 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:11:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['cc1c69bc-09ff-4004-b958-600b83b84026'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:11:27.835753 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3d3f1898-0704-4d27-a01a-67b6d6aa198a req-d5ac29e2-a854-423c-ad2e-1edb3569c106 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 210 time: 0.1927497 Nov 08 16:11:27.852375 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 59852) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:27.868144 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbed6694-eb72-4bbb-b233-14f8d38834b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a281218a-11c8-4f8e-8cc8-032178e54bb1,revision_number=0']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:27.882524 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-bbed6694-eb72-4bbb-b233-14f8d38834b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:27.886727 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-bbed6694-eb72-4bbb-b233-14f8d38834b9 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6969614 Nov 08 16:11:27.887387 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59854) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:27.891920 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-2200a9a3-44ee-4405-8a0d-808b22eac9da tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Request body: {'security_group_rule': {'security_group_id': '293f120d-5959-4f89-b76d-0686f8c34d36', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:27.898316 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-40a15f28-4378-4fe1-9817-bc0a36e11380 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:27.909014 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] Set router c3f55c44-bed1-4955-9229-dac3c412f010 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:11:28.021048 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-2200a9a3-44ee-4405-8a0d-808b22eac9da tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:28.082695 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-40a15f28-4378-4fe1-9817-bc0a36e11380 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:28.089560 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a149dd1d-0db3-4b64-8d19-d7a2773d7c77 req-c12181c9-9e09-4e2c-aea7-af6a8b98ce94 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:28.100473 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a149dd1d-0db3-4b64-8d19-d7a2773d7c77 req-c12181c9-9e09-4e2c-aea7-af6a8b98ce94 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 943 time: 0.1857381 Nov 08 16:11:28.121685 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-229c154e-0996-44dc-8bbe-9bd9c42718db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:28.172156 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-40a15f28-4378-4fe1-9817-bc0a36e11380 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:28.176129 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] Set router cc1c69bc-09ff-4004-b958-600b83b84026 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:11:28.227965 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-229c154e-0996-44dc-8bbe-9bd9c42718db None None] For port 30759480-5159-4b6e-a269-86ac7d105870, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=30759480-5159-4b6e-a269-86ac7d105870,segment=NetworkSegment(7651dfae-d245-4d32-b379-dc243d043404),segment_id=7651dfae-d245-4d32-b379-dc243d043404)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:11:28.242637 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-229c154e-0996-44dc-8bbe-9bd9c42718db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:28.257815 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-2291f45b-d38e-4034-b7d7-f253aa3f6254 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=f70ee550-62a6-48db-bca5-a0b964bbcce9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1751640 Nov 08 16:11:28.311911 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-2200a9a3-44ee-4405-8a0d-808b22eac9da tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:28.321865 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a149dd1d-0db3-4b64-8d19-d7a2773d7c77 req-56b1a90b-d70e-4bd1-bf54-51e84edce6a2 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2203486 Nov 08 16:11:28.327850 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-2200a9a3-44ee-4405-8a0d-808b22eac9da tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:28.383531 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.25', 50860) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:28.389521 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-229c154e-0996-44dc-8bbe-9bd9c42718db None None] Pushing event updated for resources: {'Port': ['ID=30759480-5159-4b6e-a269-86ac7d105870,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:28.439990 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-40a15f28-4378-4fe1-9817-bc0a36e11380 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=cdd36bd650c746b4be59d6eab45e74ad&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5864403 Nov 08 16:11:28.444220 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59866) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:28.461697 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'name': 'tempest-AttachVolumeTestJSON-272347721-router', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128'}], 'enable_snat': True}, 'gw_port_id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 4, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'gw_port': {'id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:97:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '30759480-5159-4b6e-a269-86ac7d105870', 'name': '', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'mac_address': 'fa:16:3e:86:ee:77', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:13Z', 'updated_at': '2021-11-08T16:11:27Z', 'revision_number': 4, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'subnets': [{'id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:11:28.472758 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2200a9a3-44ee-4405-8a0d-808b22eac9da tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=012b91de-8a25-41d2-9985-9a3458cfc3fb,revision_number=0']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:28.506445 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40a15f28-4378-4fe1-9817-bc0a36e11380 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f929480f-9456-491a-9c6b-5a75d8cde8dc,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:28.520158 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-2200a9a3-44ee-4405-8a0d-808b22eac9da tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:28.521978 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-2200a9a3-44ee-4405-8a0d-808b22eac9da tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.6334836 Nov 08 16:11:28.527390 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 59872) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:28.535689 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-06ac78a9-893e-4668-9b07-ea04169ee87a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:28.537475 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-06ac78a9-893e-4668-9b07-ea04169ee87a service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=170b9e4079834c589534d39e70e1dba3&device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 1097 time: 0.3599401 Nov 08 16:11:28.541492 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c1c5817-60fb-4461-b78b-03812b3485f8 None None] The sync data for ids ['c3f55c44-bed1-4955-9229-dac3c412f010'] in dv-cinder-816187-2-iscsi is: [{'id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'name': 'tempest-AttachVolumeTestJSON-272347721-router', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128'}], 'enable_snat': True}, 'gw_port_id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 4, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'gw_port': {'id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:97:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '30759480-5159-4b6e-a269-86ac7d105870', 'name': '', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'mac_address': 'fa:16:3e:86:ee:77', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:13Z', 'updated_at': '2021-11-08T16:11:27Z', 'revision_number': 4, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'subnets': [{'id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:11:28.555388 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-6a98e356-28ed-42cb-9d90-8829e65e9539 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Request body: {'floatingip': {'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:28.597883 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-863266cb-0452-45b8-b1c2-c26371b9a4c9 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=70c72d16-a0e9-49bb-b7b8-ef436d81a390 HTTP/1.1" status: 200 len: 217 time: 0.0506222 Nov 08 16:11:28.606191 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-d12a2eaf-5bff-417a-9d95-9afc2b57a25e None None] Provisioning complete for port 30759480-5159-4b6e-a269-86ac7d105870 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:28.606727 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-d12a2eaf-5bff-417a-9d95-9afc2b57a25e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:28.695260 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-ff74bdf7-0f55-49a1-8c89-5359bbce14da service neutron] 10.222.0.25 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4082901 Nov 08 16:11:28.801504 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-5c64be54-71ba-49c9-ba2f-197806153f58 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:28.803116 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-5c64be54-71ba-49c9-ba2f-197806153f58 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=caeb6ff4-65b7-4e61-97f1-b93b8755570e HTTP/1.1" status: 200 len: 851 time: 0.1950710 Nov 08 16:11:28.845393 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc1c69bc-09ff-4004-b958-600b83b84026', 'name': 'tempest-ServerRescueNegativeTestJSON-593854580-router', 'tenant_id': '4818358a827143eb9ace58a26713cdf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.169'}], 'enable_snat': True}, 'gw_port_id': '08dc39b4-7c2e-4499-b08d-d80c11a6d6ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:25Z', 'revision_number': 4, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'gw_port': {'id': '08dc39b4-7c2e-4499-b08d-d80c11a6d6ca', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:2d:58:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc1c69bc-09ff-4004-b958-600b83b84026', 'device_owner': 'network:router_gateway', 'standard_attr_id': 98, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:08Z', 'updated_at': '2021-11-08T16:11:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '8c0c4f72-e955-4eba-bada-1276c931cd7f', 'name': '', 'network_id': '2d5b5768-37f3-49a1-b451-2803f6f97429', 'tenant_id': '4818358a827143eb9ace58a26713cdf0', 'mac_address': 'fa:16:3e:5e:3a:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc1c69bc-09ff-4004-b958-600b83b84026', 'device_owner': 'network:router_interface', 'standard_attr_id': 134, 'fixed_ips': [{'subnet_id': '6936707c-bd3f-4cd8-9462-a4af0ea16ed8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:20Z', 'updated_at': '2021-11-08T16:11:26Z', 'revision_number': 2, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'subnets': [{'id': '6936707c-bd3f-4cd8-9462-a4af0ea16ed8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:11:28.868384 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6a98e356-28ed-42cb-9d90-8829e65e9539 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for floatingip, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:28.878862 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] Checking router: cc1c69bc-09ff-4004-b958-600b83b84026 for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:11:28.881393 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] Updating router cc1c69bc-09ff-4004-b958-600b83b84026 port 8c0c4f72-e955-4eba-bada-1276c931cd7f binding host dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 16:11:28.895459 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2ebc8431-8fee-4f9a-8b71-2e5113d3dc79 req-558829ab-5d25-4837-87e1-011c7640b30e service neutron] 10.222.0.25 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1870859 Nov 08 16:11:28.919686 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:28.992243 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 30759480-5159-4b6e-a269-86ac7d105870 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:11:29.002743 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-ddd8829a-482f-4714-9f2b-03caa98a3697 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:29.004329 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-ddd8829a-482f-4714-9f2b-03caa98a3697 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/networks?id=2d5b5768-37f3-49a1-b451-2803f6f97429 HTTP/1.1" status: 200 len: 818 time: 0.4070506 Nov 08 16:11:29.018128 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38c5faa8-4a0e-4e70-96be-bba1ea6b2061 req-4cb672b3-2332-4dc4-adf8-97c6498b9c22 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:29.045819 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-38c5faa8-4a0e-4e70-96be-bba1ea6b2061 req-4cb672b3-2332-4dc4-adf8-97c6498b9c22 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 944 time: 0.2677646 Nov 08 16:11:29.068073 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-ba0e9356-8e30-4fab-b48e-9683fc1d8b55 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=8d351af8-ed05-48f5-939b-8cf227b5c91c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0489213 Nov 08 16:11:29.094455 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8668cfd7-c815-4bb4-84bf-931e07fda4b2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:29.121992 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8668cfd7-c815-4bb4-84bf-931e07fda4b2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:29.143550 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 30759480-5159-4b6e-a269-86ac7d105870 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:29.143907 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:29.231390 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb6f6f67-d66a-4a6b-b7a7-47c4d960016d req-f21d404b-b7b4-45a2-b50f-5f913cac113a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:29.233157 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-bb6f6f67-d66a-4a6b-b7a7-47c4d960016d req-f21d404b-b7b4-45a2-b50f-5f913cac113a service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=549e9715f7424ff5b3b252f354adafe9&device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 1096 time: 0.1101274 Nov 08 16:11:29.324898 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-bd994bb5-3a1a-4c64-83f3-6e63b56b6d22 service neutron] 10.222.0.25 "GET /v2.0/networks/8d351af8-ed05-48f5-939b-8cf227b5c91c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2389202 Nov 08 16:11:29.368136 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-4abcc2cf-c879-4354-be8a-8e5f0c807a72 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/quotas/4818358a827143eb9ace58a26713cdf0 HTTP/1.1" status: 200 len: 375 time: 0.3193676 Nov 08 16:11:29.378077 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-75615c00-ebc5-42d0-8601-4b7d079485e3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:29.380449 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-75615c00-ebc5-42d0-8601-4b7d079485e3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.25 "GET /v2.0/networks?id=e0e08679-82fe-47eb-90b6-49a1713fdaca HTTP/1.1" status: 200 len: 817 time: 0.9924901 Nov 08 16:11:29.395892 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8668cfd7-c815-4bb4-84bf-931e07fda4b2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:29.399229 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8668cfd7-c815-4bb4-84bf-931e07fda4b2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:29.400636 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-8668cfd7-c815-4bb4-84bf-931e07fda4b2 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/f929480f-9456-491a-9c6b-5a75d8cde8dc HTTP/1.1" status: 204 len: 168 time: 0.9524889 Nov 08 16:11:29.440918 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] Publish callbacks [] for port, precommit_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:29.456052 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:29.475914 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8668cfd7-c815-4bb4-84bf-931e07fda4b2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f929480f-9456-491a-9c6b-5a75d8cde8dc,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:29.519573 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb6f6f67-d66a-4a6b-b7a7-47c4d960016d req-dc6c35f2-82c4-4a99-8633-632d9e3c9c0b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:29.521161 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-bb6f6f67-d66a-4a6b-b7a7-47c4d960016d req-dc6c35f2-82c4-4a99-8633-632d9e3c9c0b service neutron] 10.222.0.25 "GET /v2.0/networks?id=f70ee550-62a6-48db-bca5-a0b964bbcce9 HTTP/1.1" status: 200 len: 916 time: 0.2788551 Nov 08 16:11:29.580401 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-38c5faa8-4a0e-4e70-96be-bba1ea6b2061 req-4eedd5d8-f350-4f9b-a032-c044114e9612 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5071857 Nov 08 16:11:29.594808 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb53f4c5-1e50-4901-87b2-4c1bed6b29aa None None] Pushing event updated for resources: {'Port': ['ID=8c0c4f72-e955-4eba-bada-1276c931cd7f,revision_number=3']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:29.596191 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ec4f96b9-4128-4da6-9880-95a0f72fd4e2', 'tag': '70c72d16-a0e9-49bb-b7b8-ef436d81a390'}] {{(pid=101245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:11:29.598649 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9303bddee447de525cefc409d3d14f9dbe8ef1f21bfe9eb24fdef2609d4aa3c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a790e770-4342-46ca-bf68-4f089a9a4601" -d '{"events": [{"name": "network-changed", "server_uuid": "ec4f96b9-4128-4da6-9880-95a0f72fd4e2", "tag": "70c72d16-a0e9-49bb-b7b8-ef436d81a390"}]}' {{(pid=101245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:11:29.636458 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-308fd414-0f2a-47ab-911e-dadd92afd1c4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?tenant_id=4818358a827143eb9ace58a26713cdf0&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2520301 Nov 08 16:11:29.712312 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] Attempting to bind port 8c0c4f72-e955-4eba-bada-1276c931cd7f on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:11:29.712900 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] Attempting to bind port 8c0c4f72-e955-4eba-bada-1276c931cd7f by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': 'e14404ea-b710-490a-b578-a605dfc73350', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '2d5b5768-37f3-49a1-b451-2803f6f97429'}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:11:29.713091 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] Attempting to bind port 8c0c4f72-e955-4eba-bada-1276c931cd7f on network 2d5b5768-37f3-49a1-b451-2803f6f97429 {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:11:29.721521 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 11, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:11:29.721913 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] Checking segment: {'id': 'e14404ea-b710-490a-b578-a605dfc73350', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '2d5b5768-37f3-49a1-b451-2803f6f97429'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:11:29.722334 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:29.722765 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] Bound using segment: {'id': 'e14404ea-b710-490a-b578-a605dfc73350', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '2d5b5768-37f3-49a1-b451-2803f6f97429'} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:11:29.723246 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] Bound port: 8c0c4f72-e955-4eba-bada-1276c931cd7f, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e14404ea-b710-490a-b578-a605dfc73350', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '2d5b5768-37f3-49a1-b451-2803f6f97429'}}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:11:29.723607 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:29.807007 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-2e034e7a-54b7-4c93-b23e-e82aaa3c42ff service neutron] 10.222.0.37 "GET /v2.0/networks/2d5b5768-37f3-49a1-b451-2803f6f97429?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1455643 Nov 08 16:11:29.817278 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-2b09dcb4-09a1-4e3a-afed-6b9ffe126562 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.25 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=10a4252a63bf480d93d2e9da15bb8efd HTTP/1.1" status: 200 len: 380 time: 0.3884742 Nov 08 16:11:29.870566 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] For port 8c0c4f72-e955-4eba-bada-1276c931cd7f, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:11:29.872880 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a0a272ea-f955-4b49-8f9f-724f8945ed68 req-d385d3c9-269c-4d74-86a9-a4f92a13fc92 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 210 time: 0.0645165 Nov 08 16:11:29.895997 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] For port 8c0c4f72-e955-4eba-bada-1276c931cd7f, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=8c0c4f72-e955-4eba-bada-1276c931cd7f,segment=NetworkSegment(e14404ea-b710-490a-b578-a605dfc73350),segment_id=e14404ea-b710-490a-b578-a605dfc73350)] {{(pid=101246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:11:29.902122 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:29.929360 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6a98e356-28ed-42cb-9d90-8829e65e9539 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:30.041061 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] Routers {'cc1c69bc-09ff-4004-b958-600b83b84026'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:11:30.041739 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:11:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['cc1c69bc-09ff-4004-b958-600b83b84026'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:11:30.041936 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-bb6f6f67-d66a-4a6b-b7a7-47c4d960016d req-fbe58b23-49bc-4734-8ca5-f3ced194949c service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4020a644-ef2e-4dd8-931a-cfccef4e7b15 HTTP/1.1" status: 200 len: 217 time: 0.4269099 Nov 08 16:11:30.106585 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-fa2ef8e5-bac6-4fc1-a80a-ab36e6dbc293 req-bd5a29d6-0e35-459e-b698-8db226c5a5c0 service neutron] 10.222.0.25 "GET /v2.0/networks/8d351af8-ed05-48f5-939b-8cf227b5c91c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5843427 Nov 08 16:11:30.129194 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb53f4c5-1e50-4901-87b2-4c1bed6b29aa None None] Pushing event updated for resources: {'Port': ['ID=8c0c4f72-e955-4eba-bada-1276c931cd7f,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:30.133088 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0ab194a-3276-4858-b374-529c20a434d9 req-ea75f1db-c304-4d48-a73c-53c8087db6e8 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:30.134644 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f0ab194a-3276-4858-b374-529c20a434d9 req-ea75f1db-c304-4d48-a73c-53c8087db6e8 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 943 time: 0.1070802 Nov 08 16:11:30.136481 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-8bcfa410-79bc-4a97-b3e6-1f2bc78fd001 service neutron] 10.222.0.37 "GET /v2.0/networks/2d5b5768-37f3-49a1-b451-2803f6f97429?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3072441 Nov 08 16:11:30.219077 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f0ab194a-3276-4858-b374-529c20a434d9 req-4133468d-98d0-4c27-a062-33cf01147188 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0637469 Nov 08 16:11:30.228806 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [None req-6a98e356-28ed-42cb-9d90-8829e65e9539 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Allocated IP 172.27.3.45 (68f46265-b42a-49a0-8d57-f9362045cd9b/4728e4be-5a19-43c0-89cf-ced2a190645d/1cec4a34-ed13-464b-b8ae-41a1691cba6d) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:11:30.319812 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] Set router cc1c69bc-09ff-4004-b958-600b83b84026 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:11:30.417503 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:11:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3aeae958-c62c-4bc2-974b-3cf3f2988e15 x-openstack-request-id: req-3aeae958-c62c-4bc2-974b-3cf3f2988e15 {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:11:30.420808 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ec4f96b9-4128-4da6-9880-95a0f72fd4e2", "tag": "70c72d16-a0e9-49bb-b7b8-ef436d81a390", "status": "completed", "code": 200}]} {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:11:30.421220 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-3aeae958-c62c-4bc2-974b-3cf3f2988e15 {{(pid=101245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:11:30.422838 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ec4f96b9-4128-4da6-9880-95a0f72fd4e2', 'tag': '70c72d16-a0e9-49bb-b7b8-ef436d81a390', 'status': 'completed', 'code': 200} Nov 08 16:11:30.487604 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9c38e397-b129-4e08-89bf-cbc973147607 req-275ae696-fe5d-45d9-a345-7d9d6e725b52 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 210 time: 0.0403328 Nov 08 16:11:30.491750 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6a98e356-28ed-42cb-9d90-8829e65e9539 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:30.609259 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6a98e356-28ed-42cb-9d90-8829e65e9539 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:30.688616 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a98e356-28ed-42cb-9d90-8829e65e9539 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Pushing event updated for resources: {'Port': ['ID=1cec4a34-ed13-464b-b8ae-41a1691cba6d,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:30.723283 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6a98e356-28ed-42cb-9d90-8829e65e9539 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Network 68f46265-b42a-49a0-8d57-f9362045cd9b is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:11:30.736002 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-6a98e356-28ed-42cb-9d90-8829e65e9539 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:11:30.770652 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a98e356-28ed-42cb-9d90-8829e65e9539 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:11:30.797428 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc1c69bc-09ff-4004-b958-600b83b84026', 'name': 'tempest-ServerRescueNegativeTestJSON-593854580-router', 'tenant_id': '4818358a827143eb9ace58a26713cdf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.169'}], 'enable_snat': True}, 'gw_port_id': '08dc39b4-7c2e-4499-b08d-d80c11a6d6ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:25Z', 'revision_number': 4, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'gw_port': {'id': '08dc39b4-7c2e-4499-b08d-d80c11a6d6ca', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:2d:58:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc1c69bc-09ff-4004-b958-600b83b84026', 'device_owner': 'network:router_gateway', 'standard_attr_id': 98, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:08Z', 'updated_at': '2021-11-08T16:11:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '8c0c4f72-e955-4eba-bada-1276c931cd7f', 'name': '', 'network_id': '2d5b5768-37f3-49a1-b451-2803f6f97429', 'tenant_id': '4818358a827143eb9ace58a26713cdf0', 'mac_address': 'fa:16:3e:5e:3a:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc1c69bc-09ff-4004-b958-600b83b84026', 'device_owner': 'network:router_interface', 'standard_attr_id': 134, 'fixed_ips': [{'subnet_id': '6936707c-bd3f-4cd8-9462-a4af0ea16ed8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:20Z', 'updated_at': '2021-11-08T16:11:29Z', 'revision_number': 4, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'subnets': [{'id': '6936707c-bd3f-4cd8-9462-a4af0ea16ed8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:11:30.831683 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-54883a24-3056-4631-a20d-ad4b3870a1f8 None None] The sync data for ids ['cc1c69bc-09ff-4004-b958-600b83b84026'] in dv-cinder-816187-2-iscsi is: [{'id': 'cc1c69bc-09ff-4004-b958-600b83b84026', 'name': 'tempest-ServerRescueNegativeTestJSON-593854580-router', 'tenant_id': '4818358a827143eb9ace58a26713cdf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.169'}], 'enable_snat': True}, 'gw_port_id': '08dc39b4-7c2e-4499-b08d-d80c11a6d6ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:25Z', 'revision_number': 4, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'gw_port': {'id': '08dc39b4-7c2e-4499-b08d-d80c11a6d6ca', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:2d:58:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc1c69bc-09ff-4004-b958-600b83b84026', 'device_owner': 'network:router_gateway', 'standard_attr_id': 98, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:08Z', 'updated_at': '2021-11-08T16:11:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '8c0c4f72-e955-4eba-bada-1276c931cd7f', 'name': '', 'network_id': '2d5b5768-37f3-49a1-b451-2803f6f97429', 'tenant_id': '4818358a827143eb9ace58a26713cdf0', 'mac_address': 'fa:16:3e:5e:3a:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc1c69bc-09ff-4004-b958-600b83b84026', 'device_owner': 'network:router_interface', 'standard_attr_id': 134, 'fixed_ips': [{'subnet_id': '6936707c-bd3f-4cd8-9462-a4af0ea16ed8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:20Z', 'updated_at': '2021-11-08T16:11:29Z', 'revision_number': 4, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'subnets': [{'id': '6936707c-bd3f-4cd8-9462-a4af0ea16ed8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:11:30.896836 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a97888fd-f08f-4a22-83fa-4ce410ee6541 req-d132b424-ffc0-47dc-8d61-5a3e4c347349 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:30.898407 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a97888fd-f08f-4a22-83fa-4ce410ee6541 req-d132b424-ffc0-47dc-8d61-5a3e4c347349 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 944 time: 0.2117941 Nov 08 16:11:30.916525 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6a98e356-28ed-42cb-9d90-8829e65e9539 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:31.002273 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-e3adb0cb-3947-4348-9ebd-844b82dff4bc tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:31.003744 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-e3adb0cb-3947-4348-9ebd-844b82dff4bc tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/networks?id=2d5b5768-37f3-49a1-b451-2803f6f97429 HTTP/1.1" status: 200 len: 818 time: 0.2168722 Nov 08 16:11:31.007103 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6a98e356-28ed-42cb-9d90-8829e65e9539 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:31.053835 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a97888fd-f08f-4a22-83fa-4ce410ee6541 req-fcc71def-6198-4bf4-921e-98ed9cd4ee80 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1455612 Nov 08 16:11:31.060343 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-0196d288-cffb-40b1-8f86-7156fbd66765 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/quotas/4818358a827143eb9ace58a26713cdf0 HTTP/1.1" status: 200 len: 375 time: 0.0469356 Nov 08 16:11:31.203758 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-99872488-7883-43fb-a390-5dfc4de3840c req-bf3a60e7-4186-4196-a63d-c0e97b04959f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 210 time: 0.0842249 Nov 08 16:11:31.265465 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-4356f257-f35a-4ccf-86b1-8a4fbdfac171 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?tenant_id=4818358a827143eb9ace58a26713cdf0&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2042232 Nov 08 16:11:31.340890 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6a98e356-28ed-42cb-9d90-8829e65e9539 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:31.355163 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6a98e356-28ed-42cb-9d90-8829e65e9539 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:31.430154 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6a98e356-28ed-42cb-9d90-8829e65e9539 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-2032271'] for floatingip, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:31.474819 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a98e356-28ed-42cb-9d90-8829e65e9539 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Pushing event updated for resources: {'Port': ['ID=1cec4a34-ed13-464b-b8ae-41a1691cba6d,revision_number=2']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:31.486915 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe8eb2c-4932-40f2-b4b3-c982c2216f66 req-25efdf0e-e6c3-4173-bffd-a61c12f4bba1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:31.494190 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ebe8eb2c-4932-40f2-b4b3-c982c2216f66 req-25efdf0e-e6c3-4173-bffd-a61c12f4bba1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 943 time: 0.1574976 Nov 08 16:11:31.498270 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6a98e356-28ed-42cb-9d90-8829e65e9539 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for floatingip, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:31.508372 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-6a98e356-28ed-42cb-9d90-8829e65e9539 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 2.9545436 Nov 08 16:11:31.508372 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-0d651af1-40a8-46bc-870b-d8bc11ff33fa service neutron] 10.222.0.37 "GET /v2.0/networks/2d5b5768-37f3-49a1-b451-2803f6f97429?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2270589 Nov 08 16:11:31.622182 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ebe8eb2c-4932-40f2-b4b3-c982c2216f66 req-b33b2fe5-a7a1-40a1-9aec-e0bf5f07a1f8 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1132591 Nov 08 16:11:31.666125 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-1e105599-0b82-47f4-8e0e-701da2834151 service neutron] 10.222.0.37 "GET /v2.0/networks/2d5b5768-37f3-49a1-b451-2803f6f97429?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1429272 Nov 08 16:11:31.790330 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-4c1da319-6e34-40e9-8e13-7a7514382611 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?name=tempest-securitygroup--843466784&fields=id&tenant_id=f6e779f0506643d08d984c2971d5a71c HTTP/1.1" status: 200 len: 267 time: 0.0621974 Nov 08 16:11:31.901543 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ca3cd31c-3c43-4c06-ae38-88852b205ae1 req-b5127934-868a-4067-9549-414436cecf88 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 210 time: 0.0640726 Nov 08 16:11:31.979898 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-8f848e59-18fe-44e1-92bc-5873f55bacdf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:31.987248 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-8f848e59-18fe-44e1-92bc-5873f55bacdf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/networks?id=75fa9c3e-7bfe-490a-9118-221394c29646 HTTP/1.1" status: 200 len: 810 time: 0.1880615 Nov 08 16:11:31.998332 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-da26dbf4-b57b-4fac-80e0-ff6872c46aa3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/quotas/f6e779f0506643d08d984c2971d5a71c HTTP/1.1" status: 200 len: 375 time: 0.0102320 Nov 08 16:11:32.066191 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-f0f5be1b-3af9-4996-a89f-a7e285284d69 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?tenant_id=f6e779f0506643d08d984c2971d5a71c&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0560148 Nov 08 16:11:32.385625 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-fb7bae1d-03eb-45e2-a91f-53d58e0e5359 service neutron] 10.222.0.37 "GET /v2.0/networks/75fa9c3e-7bfe-490a-9118-221394c29646?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3162808 Nov 08 16:11:32.409439 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-598fb43d-0f0a-4fc8-8d4a-5ea730cd2819 req-aea975f6-e1b8-4b8f-9ccb-8c60a74bb137 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:32.410924 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-598fb43d-0f0a-4fc8-8d4a-5ea730cd2819 req-aea975f6-e1b8-4b8f-9ccb-8c60a74bb137 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 944 time: 0.2388668 Nov 08 16:11:32.507940 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-598fb43d-0f0a-4fc8-8d4a-5ea730cd2819 req-05b0e9a2-b2ca-4933-b99f-4a10c5f15629 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0867572 Nov 08 16:11:32.517858 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-e2309c1d-3c40-4680-8f27-e141371e4764 service neutron] 10.222.0.37 "GET /v2.0/networks/75fa9c3e-7bfe-490a-9118-221394c29646?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1241541 Nov 08 16:11:32.532648 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-e140318d-8b8e-4910-b947-1a8b5efadc7b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Request body: {'port': {'device_id': '1c1c8c8d-5f78-45fb-803d-8f7a84df3433', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'admin_state_up': True, 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'security_groups': ['25b22689-a549-4355-8242-c53382d480a6']}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:32.609876 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a6299bf6-84d4-4a7d-be17-6f68b39ad6a6 req-0a86e85c-875b-4cab-9a96-735de2a465ed tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 210 time: 0.0324667 Nov 08 16:11:32.744197 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-56094376-b6fd-4a4f-aa34-615cc117044d req-3f848a64-aa91-42c1-8462-e44041df2391 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 210 time: 0.0609536 Nov 08 16:11:32.761285 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-e140318d-8b8e-4910-b947-1a8b5efadc7b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Made reservation on behalf of 10a4252a63bf480d93d2e9da15bb8efd for: {'port': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:11:32.764922 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-e140318d-8b8e-4910-b947-1a8b5efadc7b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:32.794368 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f38f1053-1a26-4890-8991-67f87df7cc54 req-87a20dee-6a22-4603-b86c-ef4d3f0180c3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:32.795830 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f38f1053-1a26-4890-8991-67f87df7cc54 req-87a20dee-6a22-4603-b86c-ef4d3f0180c3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 943 time: 0.1115859 Nov 08 16:11:32.920642 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 8c0c4f72-e955-4eba-bada-1276c931cd7f up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:11:32.980391 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 8c0c4f72-e955-4eba-bada-1276c931cd7f triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:32.981303 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:33.014337 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f38f1053-1a26-4890-8991-67f87df7cc54 req-edcc6b92-fe20-4864-bdc7-121c02bbf95d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2114081 Nov 08 16:11:33.046637 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-64c2c007-39f6-4991-9708-feeff2aa9aef req-6a609fe2-722f-41ba-a876-4acd5824a94e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 210 time: 0.0569758 Nov 08 16:11:33.076519 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:33.083064 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-e140318d-8b8e-4910-b947-1a8b5efadc7b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Allocated IP 172.20.0.9 (e0e08679-82fe-47eb-90b6-49a1713fdaca/fc52ff8b-1692-487b-a0de-f6290e65d880/fbefda08-fc7a-42a0-b714-6dea3d8a5161) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:11:33.108365 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] For port 8c0c4f72-e955-4eba-bada-1276c931cd7f, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=8c0c4f72-e955-4eba-bada-1276c931cd7f,segment=NetworkSegment(e14404ea-b710-490a-b578-a605dfc73350),segment_id=e14404ea-b710-490a-b578-a605dfc73350)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:11:33.113763 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:33.163916 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Pushing event updated for resources: {'Port': ['ID=8c0c4f72-e955-4eba-bada-1276c931cd7f,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:33.217506 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-e140318d-8b8e-4910-b947-1a8b5efadc7b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:33.249625 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-e140318d-8b8e-4910-b947-1a8b5efadc7b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:33.323338 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-e140318d-8b8e-4910-b947-1a8b5efadc7b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Network e0e08679-82fe-47eb-90b6-49a1713fdaca is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:11:33.330270 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-e140318d-8b8e-4910-b947-1a8b5efadc7b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:11:33.337476 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-e140318d-8b8e-4910-b947-1a8b5efadc7b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:11:33.342622 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-e140318d-8b8e-4910-b947-1a8b5efadc7b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:33.343249 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-e140318d-8b8e-4910-b947-1a8b5efadc7b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:33.354725 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e140318d-8b8e-4910-b947-1a8b5efadc7b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Pushing event updated for resources: {'Port': ['ID=fbefda08-fc7a-42a0-b714-6dea3d8a5161,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:33.366093 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-e140318d-8b8e-4910-b947-1a8b5efadc7b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8373833 Nov 08 16:11:33.585634 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-f1589d7f-b421-428e-bcc6-ba73ffd663e4 None None] Provisioning complete for port fbefda08-fc7a-42a0-b714-6dea3d8a5161 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:33.585947 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-f1589d7f-b421-428e-bcc6-ba73ffd663e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:33.617811 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-f1589d7f-b421-428e-bcc6-ba73ffd663e4 None None] Port fbefda08-fc7a-42a0-b714-6dea3d8a5161 cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:11:33.619386 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaceb25c-ea1a-4ea4-8060-65b6eb760528 req-33c4028e-4a9c-4640-a6fc-43da48341559 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:33.620974 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-aaceb25c-ea1a-4ea4-8060-65b6eb760528 req-33c4028e-4a9c-4640-a6fc-43da48341559 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 944 time: 0.0472376 Nov 08 16:11:33.667854 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-aaceb25c-ea1a-4ea4-8060-65b6eb760528 req-96dc6cf5-5cfc-4cdd-89c2-3ed02d8169f7 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406971 Nov 08 16:11:33.735067 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dd8df66-b380-4f07-9080-8c4e220436a7 req-e765ba3c-6518-444b-b911-1733611fd949 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:33.736519 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8dd8df66-b380-4f07-9080-8c4e220436a7 req-e765ba3c-6518-444b-b911-1733611fd949 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 931 time: 0.0508554 Nov 08 16:11:33.782728 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8dd8df66-b380-4f07-9080-8c4e220436a7 req-32a66dd9-197d-47b5-823f-094f6f1e2522 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402937 Nov 08 16:11:33.837625 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-df261982-f36b-48b8-98ff-db1dbd00867d req-4fa8883a-39a5-476b-8a91-c3140075dbac tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 210 time: 0.0252938 Nov 08 16:11:34.102026 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb6f6f67-d66a-4a6b-b7a7-47c4d960016d req-8c452049-66b9-4702-b872-174277a777b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:34.103465 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-bb6f6f67-d66a-4a6b-b7a7-47c4d960016d req-8c452049-66b9-4702-b872-174277a777b8 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=cd23e532-b366-42a0-82e4-ec7326cf3b48 HTTP/1.1" status: 200 len: 855 time: 0.0507393 Nov 08 16:11:34.155350 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cceebad0-bcdb-4143-aae5-cabb3945e2f7 req-e5906c2e-7412-43e0-8454-b5bbc6426023 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:34.156825 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cceebad0-bcdb-4143-aae5-cabb3945e2f7 req-e5906c2e-7412-43e0-8454-b5bbc6426023 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 943 time: 0.0775952 Nov 08 16:11:34.158554 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dfb428da-5674-463d-8917-9a6ca0b45c9f req-f02315fb-daf3-4d45-81d8-c7faf4e50074 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 210 time: 0.0384810 Nov 08 16:11:34.205507 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cceebad0-bcdb-4143-aae5-cabb3945e2f7 req-877b97f0-cbe1-49d0-b9c6-2086f60f9cac tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424068 Nov 08 16:11:34.436195 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-32f009f0-379f-4e3a-a684-fdd6d6911ed9 service neutron] Request body: {'port': {'device_id': '1c1c8c8d-5f78-45fb-803d-8f7a84df3433', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81618'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:34.492191 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-bb6f6f67-d66a-4a6b-b7a7-47c4d960016d req-013196c2-36c8-4a7f-ab0a-192054bc1735 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=f70ee550-62a6-48db-bca5-a0b964bbcce9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0623300 Nov 08 16:11:34.520193 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-32f009f0-379f-4e3a-a684-fdd6d6911ed9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:34.590200 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a790e770-4342-46ca-bf68-4f089a9a4601 req-41502e10-616d-4bcd-b041-07d088511c1b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:34.591693 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-a790e770-4342-46ca-bf68-4f089a9a4601 req-41502e10-616d-4bcd-b041-07d088511c1b service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=170b9e4079834c589534d39e70e1dba3&device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 1097 time: 0.1440420 Nov 08 16:11:34.628918 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-bb6f6f67-d66a-4a6b-b7a7-47c4d960016d req-d401c232-d520-4ac4-a8db-0f84d29241c0 service neutron] 10.222.0.25 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1096847 Nov 08 16:11:34.837256 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44b66aa1-ee83-4c15-bcb3-fdda07e0f9cf req-a52ebe37-65b6-47d2-8718-35385274df98 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:34.839003 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-44b66aa1-ee83-4c15-bcb3-fdda07e0f9cf req-a52ebe37-65b6-47d2-8718-35385274df98 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 944 time: 0.0774355 Nov 08 16:11:34.848602 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-bb6f6f67-d66a-4a6b-b7a7-47c4d960016d req-5713453c-dfca-4901-b63d-ef5ef9f0142c service neutron] 10.222.0.25 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1831706 Nov 08 16:11:34.849653 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a790e770-4342-46ca-bf68-4f089a9a4601 req-84215636-ab4d-4aac-b464-9e310a6bd31b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:34.851010 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-a790e770-4342-46ca-bf68-4f089a9a4601 req-84215636-ab4d-4aac-b464-9e310a6bd31b service neutron] 10.222.0.25 "GET /v2.0/networks?id=8d351af8-ed05-48f5-939b-8cf227b5c91c HTTP/1.1" status: 200 len: 912 time: 0.1954706 Nov 08 16:11:34.900478 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-a790e770-4342-46ca-bf68-4f089a9a4601 req-d6b5dbb4-3a01-4f85-aecb-fdd96f162f73 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=70c72d16-a0e9-49bb-b7b8-ef436d81a390 HTTP/1.1" status: 200 len: 217 time: 0.0393493 Nov 08 16:11:34.904464 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 8c0c4f72-e955-4eba-bada-1276c931cd7f up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:11:34.952846 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a790e770-4342-46ca-bf68-4f089a9a4601 req-3b7bec9f-2659-4911-9779-fd4b91d75e11 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:34.954434 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-a790e770-4342-46ca-bf68-4f089a9a4601 req-3b7bec9f-2659-4911-9779-fd4b91d75e11 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=caeb6ff4-65b7-4e61-97f1-b93b8755570e HTTP/1.1" status: 200 len: 851 time: 0.0454216 Nov 08 16:11:34.955020 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 8c0c4f72-e955-4eba-bada-1276c931cd7f triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:34.955386 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:34.968390 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-44b66aa1-ee83-4c15-bcb3-fdda07e0f9cf req-7ff8cb60-4e25-47cb-873d-d4ecc889e6d6 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1224499 Nov 08 16:11:34.975099 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-32f009f0-379f-4e3a-a684-fdd6d6911ed9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fbefda08-fc7a-42a0-b714-6dea3d8a5161 {{(pid=101244) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:11:34.992976 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-32f009f0-379f-4e3a-a684-fdd6d6911ed9 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:34.995388 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-a790e770-4342-46ca-bf68-4f089a9a4601 req-f790d481-2cfc-423a-bc40-1c5cfe4c1c69 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=8d351af8-ed05-48f5-939b-8cf227b5c91c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0335166 Nov 08 16:11:35.016225 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64a97f55-7574-4c97-9316-ff204d342d42 req-c58d45cc-88b3-4e32-af4a-fd3be7751596 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:35.017893 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-64a97f55-7574-4c97-9316-ff204d342d42 req-c58d45cc-88b3-4e32-af4a-fd3be7751596 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 931 time: 0.1185076 Nov 08 16:11:35.028518 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.provisioning_blocks [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-32f009f0-379f-4e3a-a684-fdd6d6911ed9 service neutron] Transition to ACTIVE for port object fbefda08-fc7a-42a0-b714-6dea3d8a5161 will not be triggered until provisioned by entity L2. {{(pid=101244) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 16:11:35.042932 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-32f009f0-379f-4e3a-a684-fdd6d6911ed9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:35.101232 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-a790e770-4342-46ca-bf68-4f089a9a4601 req-156d1462-c1d3-46de-a0bf-d459d0f55624 service neutron] 10.222.0.25 "GET /v2.0/networks/8d351af8-ed05-48f5-939b-8cf227b5c91c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0971479 Nov 08 16:11:35.205375 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-a790e770-4342-46ca-bf68-4f089a9a4601 req-933e961b-c999-4be9-836a-cb4b1db9f2c9 service neutron] 10.222.0.25 "GET /v2.0/networks/8d351af8-ed05-48f5-939b-8cf227b5c91c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0967705 Nov 08 16:11:35.251449 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8995b8ba-12fa-42f6-a3d8-57f91d113f0f req-6896f63d-8155-4c99-8d0e-e93af44d8957 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 210 time: 0.1993845 Nov 08 16:11:35.297336 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-64a97f55-7574-4c97-9316-ff204d342d42 req-461c18e0-3632-4707-9012-28c6f36e5a3f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2685049 Nov 08 16:11:35.302780 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32f009f0-379f-4e3a-a684-fdd6d6911ed9 service neutron] Pushing event updated for resources: {'Port': ['ID=fbefda08-fc7a-42a0-b714-6dea3d8a5161,revision_number=2']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:35.389218 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-ff56f518-43e0-44fb-80e1-2e921ac5e557 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:35.390810 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-ff56f518-43e0-44fb-80e1-2e921ac5e557 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.25 "GET /v2.0/networks?id=2d5b5768-37f3-49a1-b451-2803f6f97429 HTTP/1.1" status: 200 len: 818 time: 0.1578388 Nov 08 16:11:35.404444 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-3830568c-7d81-44f1-96be-17a2492c7f1a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Request body: {'port': {'device_id': '44f7e3a8-0064-42ad-9e41-03a1ba050703', 'network_id': '2d5b5768-37f3-49a1-b451-2803f6f97429', 'admin_state_up': True, 'tenant_id': '4818358a827143eb9ace58a26713cdf0'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:35.440151 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c7bf4467-19c3-49d3-97f3-7bec1a39d118 req-32391683-23f0-4918-9a13-9d43bb3c139d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 210 time: 0.0681930 Nov 08 16:11:35.461376 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-32f009f0-379f-4e3a-a684-fdd6d6911ed9 service neutron] Attempting to bind port fbefda08-fc7a-42a0-b714-6dea3d8a5161 on host hv-cinder-81618 for vnic_type normal with profile {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:11:35.462755 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-32f009f0-379f-4e3a-a684-fdd6d6911ed9 service neutron] Attempting to bind port fbefda08-fc7a-42a0-b714-6dea3d8a5161 by drivers openvswitch,hyperv on host hv-cinder-81618 at level 0 using segments [{'id': '13aab495-f4c4-414c-b50c-fd22b4e0ef0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 188, 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca'}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:11:35.463150 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-32f009f0-379f-4e3a-a684-fdd6d6911ed9 service neutron] Attempting to bind port fbefda08-fc7a-42a0-b714-6dea3d8a5161 on network e0e08679-82fe-47eb-90b6-49a1713fdaca {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:11:35.491332 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-32f009f0-379f-4e3a-a684-fdd6d6911ed9 service neutron] Port fbefda08-fc7a-42a0-b714-6dea3d8a5161 on network e0e08679-82fe-47eb-90b6-49a1713fdaca not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81618 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 16:11:35.491332 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-32f009f0-379f-4e3a-a684-fdd6d6911ed9 service neutron] Attempting to bind port fbefda08-fc7a-42a0-b714-6dea3d8a5161 on network e0e08679-82fe-47eb-90b6-49a1713fdaca {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:11:35.499691 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-32f009f0-379f-4e3a-a684-fdd6d6911ed9 service neutron] Checking agent: {'id': '54bf9779-c14d-412a-90fc-96b4a6589d5a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81618', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'started_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 11, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:11:35.500050 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-32f009f0-379f-4e3a-a684-fdd6d6911ed9 service neutron] Checking segment: {'id': '13aab495-f4c4-414c-b50c-fd22b4e0ef0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 188, 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:11:35.500596 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-32f009f0-379f-4e3a-a684-fdd6d6911ed9 service neutron] Bound using segment: {'id': '13aab495-f4c4-414c-b50c-fd22b4e0ef0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 188, 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca'} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:11:35.501052 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-32f009f0-379f-4e3a-a684-fdd6d6911ed9 service neutron] Bound port: fbefda08-fc7a-42a0-b714-6dea3d8a5161, host: hv-cinder-81618, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '13aab495-f4c4-414c-b50c-fd22b4e0ef0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 188, 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca'}}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:11:35.501400 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-32f009f0-379f-4e3a-a684-fdd6d6911ed9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:35.531413 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b66744c-a453-4f9b-af0d-1794ed7e0a61 req-5f958c42-ce07-40bf-99cf-63bcedc85091 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:35.539191 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8b66744c-a453-4f9b-af0d-1794ed7e0a61 req-5f958c42-ce07-40bf-99cf-63bcedc85091 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 943 time: 0.1114254 Nov 08 16:11:35.569685 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-3830568c-7d81-44f1-96be-17a2492c7f1a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Made reservation on behalf of 4818358a827143eb9ace58a26713cdf0 for: {'port': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:11:35.574267 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-3830568c-7d81-44f1-96be-17a2492c7f1a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:35.627280 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8b66744c-a453-4f9b-af0d-1794ed7e0a61 req-91c1a84f-31d0-4866-9e83-bcfd2ec1a39c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0872123 Nov 08 16:11:35.628318 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-32f009f0-379f-4e3a-a684-fdd6d6911ed9 service neutron] For port fbefda08-fc7a-42a0-b714-6dea3d8a5161, host hv-cinder-81618, cleared binding levels {{(pid=101244) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:11:35.633215 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-32f009f0-379f-4e3a-a684-fdd6d6911ed9 service neutron] For port fbefda08-fc7a-42a0-b714-6dea3d8a5161, host hv-cinder-81618, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=fbefda08-fc7a-42a0-b714-6dea3d8a5161,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101244) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:11:35.638938 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-32f009f0-379f-4e3a-a684-fdd6d6911ed9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:35.679478 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-32f009f0-379f-4e3a-a684-fdd6d6911ed9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:35.680153 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-32f009f0-379f-4e3a-a684-fdd6d6911ed9 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:35.681637 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-32f009f0-379f-4e3a-a684-fdd6d6911ed9 service neutron] 10.222.0.25 "PUT /v2.0/ports/fbefda08-fc7a-42a0-b714-6dea3d8a5161 HTTP/1.1" status: 200 len: 1093 time: 1.2498267 Nov 08 16:11:35.682170 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1c1c8c8d-5f78-45fb-803d-8f7a84df3433', 'tag': 'fbefda08-fc7a-42a0-b714-6dea3d8a5161'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:11:35.749224 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_common [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-3830568c-7d81-44f1-96be-17a2492c7f1a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Allocated IP 172.20.0.9 (2d5b5768-37f3-49a1-b451-2803f6f97429/6936707c-bd3f-4cd8-9462-a4af0ea16ed8/17db566c-bf28-4091-b7f6-4ffa5f80c982) {{(pid=101245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:11:35.857522 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32f009f0-379f-4e3a-a684-fdd6d6911ed9 service neutron] Pushing event updated for resources: {'Port': ['ID=fbefda08-fc7a-42a0-b714-6dea3d8a5161,revision_number=3']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:35.935668 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-b203fbd6-aacc-4271-9960-9e96496b58fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:35.937604 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-b203fbd6-aacc-4271-9960-9e96496b58fe service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=10a4252a63bf480d93d2e9da15bb8efd&device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 1096 time: 0.1929617 Nov 08 16:11:36.043548 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f493bbcd-e014-4edc-affd-4f127802b5c4" -d '{"events": [{"name": "network-changed", "server_uuid": "1c1c8c8d-5f78-45fb-803d-8f7a84df3433", "tag": "fbefda08-fc7a-42a0-b714-6dea3d8a5161"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:11:36.047785 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-5ca29eb9-26c8-4614-9f49-a41291dce25e service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=fbefda08-fc7a-42a0-b714-6dea3d8a5161 HTTP/1.1" status: 200 len: 217 time: 0.0929453 Nov 08 16:11:36.173482 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-9d591c32-2926-44ee-ac4a-46fca4ac97cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:36.175054 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-9d591c32-2926-44ee-ac4a-46fca4ac97cb service neutron] 10.222.0.25 "GET /v2.0/subnets?id=fc52ff8b-1692-487b-a0de-f6290e65d880 HTTP/1.1" status: 200 len: 856 time: 0.1199806 Nov 08 16:11:36.194731 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e08899e-8a9a-432b-a21a-8345dc715e40 req-778333e4-63dc-4f52-8c52-e24a987199bc tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:36.196725 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3e08899e-8a9a-432b-a21a-8345dc715e40 req-778333e4-63dc-4f52-8c52-e24a987199bc tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 944 time: 0.1147525 Nov 08 16:11:36.268300 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:11:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6d79e4db-a39a-4df6-bb59-6bdda4a1119e x-openstack-request-id: req-6d79e4db-a39a-4df6-bb59-6bdda4a1119e {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:11:36.270231 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1c1c8c8d-5f78-45fb-803d-8f7a84df3433", "tag": "fbefda08-fc7a-42a0-b714-6dea3d8a5161", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:11:36.270489 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-6d79e4db-a39a-4df6-bb59-6bdda4a1119e {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:11:36.270968 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1c1c8c8d-5f78-45fb-803d-8f7a84df3433', 'tag': 'fbefda08-fc7a-42a0-b714-6dea3d8a5161', 'status': 'completed', 'code': 200} Nov 08 16:11:36.281095 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-3830568c-7d81-44f1-96be-17a2492c7f1a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Publish callbacks [] for port, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:36.294642 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-2c9225df-b44f-4aa0-b80b-a53dd9e7ea24 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:36.296708 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-2c9225df-b44f-4aa0-b80b-a53dd9e7ea24 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.25 "GET /v2.0/networks?id=2d5b5768-37f3-49a1-b451-2803f6f97429 HTTP/1.1" status: 200 len: 818 time: 0.2627816 Nov 08 16:11:36.343598 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-3830568c-7d81-44f1-96be-17a2492c7f1a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:36.371240 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-84deba19-a65f-4384-92be-c8c0247d1798 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:36.373097 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-84deba19-a65f-4384-92be-c8c0247d1798 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=e0e08679-82fe-47eb-90b6-49a1713fdaca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1751885 Nov 08 16:11:36.389347 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e47068c0-e022-44b2-993e-0f1ae2febbf8 req-09401a5d-03c4-4c2b-ba6f-4f3805936750 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 210 time: 0.0420759 Nov 08 16:11:36.408699 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-50f1fb7b-016f-4f68-9085-dddc7a729065 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Request body: {'port': {'device_id': 'a3a953f3-d586-4495-b2d1-3c6e6cd89a52', 'network_id': '2d5b5768-37f3-49a1-b451-2803f6f97429', 'admin_state_up': True, 'tenant_id': '4818358a827143eb9ace58a26713cdf0'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:36.417982 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-3830568c-7d81-44f1-96be-17a2492c7f1a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Network 2d5b5768-37f3-49a1-b451-2803f6f97429 is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:11:36.422888 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3e08899e-8a9a-432b-a21a-8345dc715e40 req-662ccc1c-f441-46b9-af67-0ca90fe9bb92 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2155435 Nov 08 16:11:36.456406 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3830568c-7d81-44f1-96be-17a2492c7f1a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Pushing event updated for resources: {'Port': ['ID=17db566c-bf28-4091-b7f6-4ffa5f80c982,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:36.487310 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-3830568c-7d81-44f1-96be-17a2492c7f1a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:11:36.492721 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-3830568c-7d81-44f1-96be-17a2492c7f1a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Received port after_create {{(pid=101245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:11:36.500621 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-3830568c-7d81-44f1-96be-17a2492c7f1a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:36.501336 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-3830568c-7d81-44f1-96be-17a2492c7f1a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for port, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:36.529113 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-3830568c-7d81-44f1-96be-17a2492c7f1a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1283922 Nov 08 16:11:36.549763 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-d0ca4354-296c-4b28-a168-0cc8dd4131d0 service neutron] Request body: {'port': {'device_id': '44f7e3a8-0064-42ad-9e41-03a1ba050703', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81618'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:36.567302 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.25', 50881) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:36.583029 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-d3d79116-14bc-40d8-a08c-f385b25feff6 service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1591012 Nov 08 16:11:36.610588 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b303cec-9cd5-479f-9b78-1e8226a34f0c req-9beb31c8-889b-4adb-9745-e92ffdc23dc4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:36.618034 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2b303cec-9cd5-479f-9b78-1e8226a34f0c req-9beb31c8-889b-4adb-9745-e92ffdc23dc4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.1295462 Nov 08 16:11:36.623067 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-d0ca4354-296c-4b28-a168-0cc8dd4131d0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:36.683480 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2907f55c-0cce-4855-a913-3d5b769f5ba9 req-0a568edc-6336-43f2-8caf-5ea57e383abd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 210 time: 0.1169212 Nov 08 16:11:36.697544 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-50f1fb7b-016f-4f68-9085-dddc7a729065 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Made reservation on behalf of 4818358a827143eb9ace58a26713cdf0 for: {'port': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:11:36.701332 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-50f1fb7b-016f-4f68-9085-dddc7a729065 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:36.893806 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2b303cec-9cd5-479f-9b78-1e8226a34f0c req-9fe70e21-43df-4b79-9c7a-7ed05ba445c8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2748234 Nov 08 16:11:36.906689 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-0286c140-ccf0-418c-95bd-8653bceb27ba tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:36.908247 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-0286c140-ccf0-418c-95bd-8653bceb27ba tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.25 "GET /v2.0/networks?id=75fa9c3e-7bfe-490a-9118-221394c29646 HTTP/1.1" status: 200 len: 810 time: 0.3397801 Nov 08 16:11:36.921239 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2c11596b-e0dc-408c-b49c-979c4e50cd84 req-4f6ba9ce-d151-411e-9c6d-2d4eefddd9ac service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2990608 Nov 08 16:11:36.930099 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b432d875-9e0a-403f-a7b2-14dbdb4cdd12 req-6d21014a-a786-4232-bc26-f511c50b7c6a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:36.931543 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b432d875-9e0a-403f-a7b2-14dbdb4cdd12 req-6d21014a-a786-4232-bc26-f511c50b7c6a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 943 time: 0.1267240 Nov 08 16:11:36.986064 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b432d875-9e0a-403f-a7b2-14dbdb4cdd12 req-450f8fc9-fcd8-4551-94ba-e7f5e8efde1d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0478127 Nov 08 16:11:37.007349 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.notifiers.nova [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-d0ca4354-296c-4b28-a168-0cc8dd4131d0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 17db566c-bf28-4091-b7f6-4ffa5f80c982 {{(pid=101245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:11:37.014937 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-d0ca4354-296c-4b28-a168-0cc8dd4131d0 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:37.026822 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.provisioning_blocks [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-d0ca4354-296c-4b28-a168-0cc8dd4131d0 service neutron] Transition to ACTIVE for port object 17db566c-bf28-4091-b7f6-4ffa5f80c982 will not be triggered until provisioned by entity L2. {{(pid=101245) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 16:11:37.031636 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-d0ca4354-296c-4b28-a168-0cc8dd4131d0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:37.123879 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0ca4354-296c-4b28-a168-0cc8dd4131d0 service neutron] Pushing event updated for resources: {'Port': ['ID=17db566c-bf28-4091-b7f6-4ffa5f80c982,revision_number=2']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:37.126800 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_common [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-50f1fb7b-016f-4f68-9085-dddc7a729065 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Allocated IP 172.20.0.12 (2d5b5768-37f3-49a1-b451-2803f6f97429/6936707c-bd3f-4cd8-9462-a4af0ea16ed8/3e7ad14a-6975-4075-ac69-3a504ad24341) {{(pid=101245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:11:37.177106 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.managers [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-d0ca4354-296c-4b28-a168-0cc8dd4131d0 service neutron] Attempting to bind port 17db566c-bf28-4091-b7f6-4ffa5f80c982 on host hv-cinder-81618 for vnic_type normal with profile {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:11:37.177429 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.managers [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-d0ca4354-296c-4b28-a168-0cc8dd4131d0 service neutron] Attempting to bind port 17db566c-bf28-4091-b7f6-4ffa5f80c982 by drivers openvswitch,hyperv on host hv-cinder-81618 at level 0 using segments [{'id': 'e14404ea-b710-490a-b578-a605dfc73350', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '2d5b5768-37f3-49a1-b451-2803f6f97429'}] {{(pid=101245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:11:37.177774 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-d0ca4354-296c-4b28-a168-0cc8dd4131d0 service neutron] Attempting to bind port 17db566c-bf28-4091-b7f6-4ffa5f80c982 on network 2d5b5768-37f3-49a1-b451-2803f6f97429 {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:11:37.186129 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-d0ca4354-296c-4b28-a168-0cc8dd4131d0 service neutron] Port 17db566c-bf28-4091-b7f6-4ffa5f80c982 on network 2d5b5768-37f3-49a1-b451-2803f6f97429 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81618 {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 16:11:37.186440 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-d0ca4354-296c-4b28-a168-0cc8dd4131d0 service neutron] Attempting to bind port 17db566c-bf28-4091-b7f6-4ffa5f80c982 on network 2d5b5768-37f3-49a1-b451-2803f6f97429 {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:11:37.196716 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-d0ca4354-296c-4b28-a168-0cc8dd4131d0 service neutron] Checking agent: {'id': '54bf9779-c14d-412a-90fc-96b4a6589d5a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81618', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'started_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 11, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:11:37.197045 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-d0ca4354-296c-4b28-a168-0cc8dd4131d0 service neutron] Checking segment: {'id': 'e14404ea-b710-490a-b578-a605dfc73350', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '2d5b5768-37f3-49a1-b451-2803f6f97429'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:11:37.197418 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-d0ca4354-296c-4b28-a168-0cc8dd4131d0 service neutron] Bound using segment: {'id': 'e14404ea-b710-490a-b578-a605dfc73350', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '2d5b5768-37f3-49a1-b451-2803f6f97429'} {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:11:37.197863 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.managers [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-d0ca4354-296c-4b28-a168-0cc8dd4131d0 service neutron] Bound port: 17db566c-bf28-4091-b7f6-4ffa5f80c982, host: hv-cinder-81618, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e14404ea-b710-490a-b578-a605dfc73350', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '2d5b5768-37f3-49a1-b451-2803f6f97429'}}] {{(pid=101245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:11:37.198206 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-d0ca4354-296c-4b28-a168-0cc8dd4131d0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:37.330882 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-d0ca4354-296c-4b28-a168-0cc8dd4131d0 service neutron] For port 17db566c-bf28-4091-b7f6-4ffa5f80c982, host hv-cinder-81618, cleared binding levels {{(pid=101245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:11:37.338369 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-d0ca4354-296c-4b28-a168-0cc8dd4131d0 service neutron] For port 17db566c-bf28-4091-b7f6-4ffa5f80c982, host hv-cinder-81618, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=17db566c-bf28-4091-b7f6-4ffa5f80c982,segment=NetworkSegment(e14404ea-b710-490a-b578-a605dfc73350),segment_id=e14404ea-b710-490a-b578-a605dfc73350)] {{(pid=101245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:11:37.347212 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-d0ca4354-296c-4b28-a168-0cc8dd4131d0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:37.360826 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-50f1fb7b-016f-4f68-9085-dddc7a729065 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Publish callbacks [] for port, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:37.401936 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-d0ca4354-296c-4b28-a168-0cc8dd4131d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:37.402556 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-d0ca4354-296c-4b28-a168-0cc8dd4131d0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for port, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:37.403939 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-d0ca4354-296c-4b28-a168-0cc8dd4131d0 service neutron] 10.222.0.25 "PUT /v2.0/ports/17db566c-bf28-4091-b7f6-4ffa5f80c982 HTTP/1.1" status: 200 len: 1093 time: 0.8631687 Nov 08 16:11:37.404331 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '44f7e3a8-0064-42ad-9e41-03a1ba050703', 'tag': '17db566c-bf28-4091-b7f6-4ffa5f80c982'}] {{(pid=101245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:11:37.406523 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9303bddee447de525cefc409d3d14f9dbe8ef1f21bfe9eb24fdef2609d4aa3c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9d4268f0-834e-4efd-8065-04f0d0794a61" -d '{"events": [{"name": "network-changed", "server_uuid": "44f7e3a8-0064-42ad-9e41-03a1ba050703", "tag": "17db566c-bf28-4091-b7f6-4ffa5f80c982"}]}' {{(pid=101245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:11:37.441653 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0ca4354-296c-4b28-a168-0cc8dd4131d0 service neutron] Pushing event updated for resources: {'Port': ['ID=17db566c-bf28-4091-b7f6-4ffa5f80c982,revision_number=3']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:37.445530 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:11:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-90a78005-7572-48e5-98f6-d6a90c6ca70f x-openstack-request-id: req-90a78005-7572-48e5-98f6-d6a90c6ca70f {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:11:37.445837 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "44f7e3a8-0064-42ad-9e41-03a1ba050703", "tag": "17db566c-bf28-4091-b7f6-4ffa5f80c982", "status": "completed", "code": 200}]} {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:11:37.446086 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-90a78005-7572-48e5-98f6-d6a90c6ca70f {{(pid=101245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:11:37.446470 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '44f7e3a8-0064-42ad-9e41-03a1ba050703', 'tag': '17db566c-bf28-4091-b7f6-4ffa5f80c982', 'status': 'completed', 'code': 200} Nov 08 16:11:37.454181 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-50f1fb7b-016f-4f68-9085-dddc7a729065 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:37.487915 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dc52a50c-c467-42db-ac5e-4044dd242059 req-aa3ee770-dcae-43d5-89d1-c3eaffe1c161 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 210 time: 0.0258770 Nov 08 16:11:37.505796 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-50f1fb7b-016f-4f68-9085-dddc7a729065 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Network 2d5b5768-37f3-49a1-b451-2803f6f97429 is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:11:37.508572 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-50f1fb7b-016f-4f68-9085-dddc7a729065 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:11:37.510992 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-50f1fb7b-016f-4f68-9085-dddc7a729065 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Received port after_create {{(pid=101245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:11:37.516964 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-50f1fb7b-016f-4f68-9085-dddc7a729065 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:37.517597 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-50f1fb7b-016f-4f68-9085-dddc7a729065 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for port, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:37.531849 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50f1fb7b-016f-4f68-9085-dddc7a729065 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Pushing event updated for resources: {'Port': ['ID=3e7ad14a-6975-4075-ac69-3a504ad24341,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:37.543147 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-50f1fb7b-016f-4f68-9085-dddc7a729065 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.1381750 Nov 08 16:11:37.553161 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03d75cd9-4801-47b3-b72c-d9ab589fc479 req-89592a20-afff-4f14-a5c0-95e351444404 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:37.555230 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-03d75cd9-4801-47b3-b72c-d9ab589fc479 req-89592a20-afff-4f14-a5c0-95e351444404 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 944 time: 0.0584888 Nov 08 16:11:37.599883 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-03d75cd9-4801-47b3-b72c-d9ab589fc479 req-adad06fd-3061-4870-81d3-502e1dedc967 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387235 Nov 08 16:11:37.802555 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4d84187-e63b-4328-85ba-596a998ac7c1 req-e6b50379-a5f9-46c7-b5d2-785f5df93d42 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:37.804403 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c4d84187-e63b-4328-85ba-596a998ac7c1 req-e6b50379-a5f9-46c7-b5d2-785f5df93d42 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 932 time: 0.0493619 Nov 08 16:11:37.849985 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c4d84187-e63b-4328-85ba-596a998ac7c1 req-b35f18e5-5f1a-4095-87a0-b385ad139996 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388525 Nov 08 16:11:38.010227 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cd067a3-f473-483e-9953-7efd3efca91b req-3027df4e-e4ea-40f9-9273-113090980099 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:38.011876 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0cd067a3-f473-483e-9953-7efd3efca91b req-3027df4e-e4ea-40f9-9273-113090980099 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0473301 Nov 08 16:11:38.059729 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0cd067a3-f473-483e-9953-7efd3efca91b req-c09cab71-80e5-4e08-8824-b853a48629b5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421560 Nov 08 16:11:38.096078 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-747b52c8-7425-4cc4-9820-41af112b5b71 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:38.131815 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1130417b-c384-4dff-b212-afa2adeba33f req-fd2bfd9c-4406-436f-9cce-a9a6d84d017f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:38.133332 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1130417b-c384-4dff-b212-afa2adeba33f req-fd2bfd9c-4406-436f-9cce-a9a6d84d017f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 943 time: 0.0623691 Nov 08 16:11:38.180063 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1130417b-c384-4dff-b212-afa2adeba33f req-644ae68a-145d-4424-8f36-c6e3d7f53506 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408862 Nov 08 16:11:38.580747 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0ff8e280-064f-4227-9ac9-cc1c0c678886 req-8504c28f-c077-41cb-9061-5093b68887da tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 210 time: 0.0255711 Nov 08 16:11:38.710872 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a7dc5d1-2c42-4b44-be31-292cdbf253e0 req-472af568-2567-47eb-97b6-b25fba437497 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:38.712232 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0a7dc5d1-2c42-4b44-be31-292cdbf253e0 req-472af568-2567-47eb-97b6-b25fba437497 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 944 time: 0.0474448 Nov 08 16:11:38.757314 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0a7dc5d1-2c42-4b44-be31-292cdbf253e0 req-31e356ed-572c-4416-bb3a-f2f862ee5a00 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389919 Nov 08 16:11:38.963893 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f10f3973-3bac-46d0-a1b7-7fe08097e19e req-e03fc94d-27cd-40b3-a1aa-8033d2b056e0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:38.965226 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f10f3973-3bac-46d0-a1b7-7fe08097e19e req-e03fc94d-27cd-40b3-a1aa-8033d2b056e0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 932 time: 0.0508776 Nov 08 16:11:39.153569 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f10f3973-3bac-46d0-a1b7-7fe08097e19e req-ace69d96-fc33-42f3-a546-b405ae317fec tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1823156 Nov 08 16:11:39.187077 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47b842df-95ea-453a-9b37-8f78c3ed0259 req-c972c733-5b63-4281-97e6-b1b800bbb722 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:39.188489 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-47b842df-95ea-453a-9b37-8f78c3ed0259 req-c972c733-5b63-4281-97e6-b1b800bbb722 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0557160 Nov 08 16:11:39.233646 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-47b842df-95ea-453a-9b37-8f78c3ed0259 req-e89c3254-7a57-422d-a3af-c5ca7b923620 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393631 Nov 08 16:11:39.290692 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb8f1824-3095-41f6-8fdf-5a5a7bc726c6 req-6eab45d8-2746-49e9-9ef7-c5b8443a178b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:39.292150 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cb8f1824-3095-41f6-8fdf-5a5a7bc726c6 req-6eab45d8-2746-49e9-9ef7-c5b8443a178b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 943 time: 0.0471611 Nov 08 16:11:39.341914 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cb8f1824-3095-41f6-8fdf-5a5a7bc726c6 req-2f7ef16a-a217-4fbe-9c9f-c509a92a6b6f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436230 Nov 08 16:11:39.670010 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4b7e8609-7090-45c1-bf2c-e06cb17d48b9 req-eb600dbe-4989-4c20-9240-89f013ea27c3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 210 time: 0.0250688 Nov 08 16:11:39.870541 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3d32793-40cc-4c73-8ab7-d83f00837a15 req-fe9ebb80-50f8-4e53-b8bf-15254b33e589 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:39.872030 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a3d32793-40cc-4c73-8ab7-d83f00837a15 req-fe9ebb80-50f8-4e53-b8bf-15254b33e589 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 944 time: 0.0501013 Nov 08 16:11:39.919371 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a3d32793-40cc-4c73-8ab7-d83f00837a15 req-d5e38775-8213-499c-ad1e-22a57f042384 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410411 Nov 08 16:11:40.263775 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f227ff0-fe29-4a85-bb6a-ea199626002b req-da2c90b1-b2e7-4779-9d49-7c2780c8aaf7 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:40.265252 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7f227ff0-fe29-4a85-bb6a-ea199626002b req-da2c90b1-b2e7-4779-9d49-7c2780c8aaf7 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 932 time: 0.0480754 Nov 08 16:11:40.324288 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7f227ff0-fe29-4a85-bb6a-ea199626002b req-e683c3b7-c079-44dd-afb8-e3b5f000121b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0531492 Nov 08 16:11:40.360085 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65f69024-27dd-48b3-8ab1-bb1329688361 req-ec0cab39-d795-432e-a43c-7a4e4e283790 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:40.362392 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-65f69024-27dd-48b3-8ab1-bb1329688361 req-ec0cab39-d795-432e-a43c-7a4e4e283790 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0533447 Nov 08 16:11:40.414183 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-65f69024-27dd-48b3-8ab1-bb1329688361 req-0fb63401-35a9-4fee-b754-8875863c643c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465465 Nov 08 16:11:40.458483 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ad39f34-8fb6-4599-886d-fb8e8bd8b4f4 req-39f00a0d-1b48-4650-bc41-81c28147fc0c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:40.460536 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9ad39f34-8fb6-4599-886d-fb8e8bd8b4f4 req-39f00a0d-1b48-4650-bc41-81c28147fc0c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 943 time: 0.0511656 Nov 08 16:11:40.505769 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9ad39f34-8fb6-4599-886d-fb8e8bd8b4f4 req-ea4d4e5e-bbeb-4fda-897c-d4d87761b8e4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393867 Nov 08 16:11:40.572687 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-97143d43-38a6-4af3-b133-ec72bdd35677 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:40.766109 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-84cfafce-d006-492d-9bcc-4e4f28422b83 req-7b428162-e34f-4d41-8b04-2d742028ad5c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 210 time: 0.0290005 Nov 08 16:11:41.031496 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94bb88a6-39fc-4e0a-80be-75bb7d13dfe9 req-3bdb65ec-98da-43ca-97ce-7de43809ebd8 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:41.032946 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-94bb88a6-39fc-4e0a-80be-75bb7d13dfe9 req-3bdb65ec-98da-43ca-97ce-7de43809ebd8 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 944 time: 0.0479217 Nov 08 16:11:41.077889 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-94bb88a6-39fc-4e0a-80be-75bb7d13dfe9 req-2c356006-8b14-4736-af98-6234dd71312f tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391853 Nov 08 16:11:41.310606 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-add6ede0-1fd4-466f-b765-0d6c943db68b service neutron] Request body: {'port': {'device_id': 'a3a953f3-d586-4495-b2d1-3c6e6cd89a52', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81618'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:41.362263 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 70c72d16-a0e9-49bb-b7b8-ef436d81a390 details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:11:41.406422 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-add6ede0-1fd4-466f-b765-0d6c943db68b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:41.482276 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 70c72d16-a0e9-49bb-b7b8-ef436d81a390, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=70c72d16-a0e9-49bb-b7b8-ef436d81a390,segment=NetworkSegment(297c0462-3903-48e7-a4ef-95b52eec7b18),segment_id=297c0462-3903-48e7-a4ef-95b52eec7b18)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:11:41.482571 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f493bbcd-e014-4edc-affd-4f127802b5c4 req-7839ba93-1948-4b51-9642-1e39c27d234c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:41.484492 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-f493bbcd-e014-4edc-affd-4f127802b5c4 req-7839ba93-1948-4b51-9642-1e39c27d234c service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=10a4252a63bf480d93d2e9da15bb8efd&device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 1096 time: 0.1143968 Nov 08 16:11:41.498088 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': '70c72d16-a0e9-49bb-b7b8-ef436d81a390', 'network_id': '8d351af8-ed05-48f5-939b-8cf227b5c91c', 'port_id': '70c72d16-a0e9-49bb-b7b8-ef436d81a390', 'mac_address': 'fa:16:3e:c6:9f:47', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 163, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'caeb6ff4-65b7-4e61-97f1-b93b8755570e', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:11:41.500615 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-d57e276b-182c-41cf-9334-e8f7f33145e7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.25 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f6e779f0506643d08d984c2971d5a71c HTTP/1.1" status: 200 len: 379 time: 0.1948214 Nov 08 16:11:41.513125 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-10b19368-fc14-4519-914e-2ce8e244c00e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Request body: {'port': {'device_id': 'b76ed94d-63f4-4597-be02-f3fc032b85aa', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'admin_state_up': True, 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'security_groups': ['293f120d-5959-4f89-b76d-0686f8c34d36']}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:41.540833 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:41.555938 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:41.569423 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 70c72d16-a0e9-49bb-b7b8-ef436d81a390 {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:11:41.590372 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 70c72d16-a0e9-49bb-b7b8-ef436d81a390, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=70c72d16-a0e9-49bb-b7b8-ef436d81a390,segment=NetworkSegment(297c0462-3903-48e7-a4ef-95b52eec7b18),segment_id=297c0462-3903-48e7-a4ef-95b52eec7b18)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:11:41.597113 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:41.598117 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 4020a644-ef2e-4dd8-931a-cfccef4e7b15 details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:11:41.598798 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d4268f0-834e-4efd-8065-04f0d0794a61 req-09655749-ce54-42dd-8e27-fd018da080fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:41.601076 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9d4268f0-834e-4efd-8065-04f0d0794a61 req-09655749-ce54-42dd-8e27-fd018da080fc service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=4818358a827143eb9ace58a26713cdf0&device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 1096 time: 0.2395811 Nov 08 16:11:41.634790 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7c6354a-c6fd-46a9-b435-72ab1cd452c6 req-368a8066-719b-4123-bcc2-f2affd3aebe3 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:41.636443 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e7c6354a-c6fd-46a9-b435-72ab1cd452c6 req-368a8066-719b-4123-bcc2-f2affd3aebe3 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 932 time: 0.2275565 Nov 08 16:11:41.654480 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=70c72d16-a0e9-49bb-b7b8-ef436d81a390,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:41.701730 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f493bbcd-e014-4edc-affd-4f127802b5c4 req-a9e4bdbf-76ed-4245-a2b9-d06f07023669 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:41.703325 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-f493bbcd-e014-4edc-affd-4f127802b5c4 req-a9e4bdbf-76ed-4245-a2b9-d06f07023669 service neutron] 10.222.0.25 "GET /v2.0/networks?id=e0e08679-82fe-47eb-90b6-49a1713fdaca HTTP/1.1" status: 200 len: 918 time: 0.1581106 Nov 08 16:11:41.748033 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 4020a644-ef2e-4dd8-931a-cfccef4e7b15, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=4020a644-ef2e-4dd8-931a-cfccef4e7b15,segment=NetworkSegment(fab7ad78-c438-48e7-8fdb-80ff50b8600c),segment_id=fab7ad78-c438-48e7-8fdb-80ff50b8600c)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:11:41.752528 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-f493bbcd-e014-4edc-affd-4f127802b5c4 req-a883faf0-906f-43d6-ac32-e6f4faa26d1d service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=fbefda08-fc7a-42a0-b714-6dea3d8a5161 HTTP/1.1" status: 200 len: 217 time: 0.0410001 Nov 08 16:11:41.752806 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b99acc6-512d-45ae-8092-06611de3b868 req-682cf570-54e8-4b65-9127-2cb86cd799a5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:41.754364 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1b99acc6-512d-45ae-8092-06611de3b868 req-682cf570-54e8-4b65-9127-2cb86cd799a5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.2343051 Nov 08 16:11:41.763662 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': '4020a644-ef2e-4dd8-931a-cfccef4e7b15', 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9', 'port_id': '4020a644-ef2e-4dd8-931a-cfccef4e7b15', 'mac_address': 'fa:16:3e:68:38:54', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 173, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cd23e532-b366-42a0-82e4-ec7326cf3b48', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:11:41.823090 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:41.833137 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4020a644-ef2e-4dd8-931a-cfccef4e7b15 {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:11:41.845373 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f493bbcd-e014-4edc-affd-4f127802b5c4 req-8983835c-691c-4c5e-81b0-04cc4ac0f460 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:41.846846 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-f493bbcd-e014-4edc-affd-4f127802b5c4 req-8983835c-691c-4c5e-81b0-04cc4ac0f460 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=fc52ff8b-1692-487b-a0de-f6290e65d880 HTTP/1.1" status: 200 len: 856 time: 0.0850275 Nov 08 16:11:41.852827 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 4020a644-ef2e-4dd8-931a-cfccef4e7b15, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=4020a644-ef2e-4dd8-931a-cfccef4e7b15,segment=NetworkSegment(fab7ad78-c438-48e7-8fdb-80ff50b8600c),segment_id=fab7ad78-c438-48e7-8fdb-80ff50b8600c)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:11:41.859073 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:41.868548 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.notifiers.nova [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-add6ede0-1fd4-466f-b765-0d6c943db68b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3e7ad14a-6975-4075-ac69-3a504ad24341 {{(pid=101245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:11:41.890472 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-add6ede0-1fd4-466f-b765-0d6c943db68b service neutron] Publish callbacks [] for port, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:41.892721 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e7c6354a-c6fd-46a9-b435-72ab1cd452c6 req-f498157e-7ed5-436c-969b-ae5f467a81e1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2260940 Nov 08 16:11:41.915869 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=4020a644-ef2e-4dd8-931a-cfccef4e7b15,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:41.928819 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.provisioning_blocks [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-add6ede0-1fd4-466f-b765-0d6c943db68b service neutron] Transition to ACTIVE for port object 3e7ad14a-6975-4075-ac69-3a504ad24341 will not be triggered until provisioned by entity L2. {{(pid=101245) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 16:11:41.938268 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1b99acc6-512d-45ae-8092-06611de3b868 req-1528c96f-7df7-41d8-bbb1-e955e8774845 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1688170 Nov 08 16:11:41.939043 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f493bbcd-e014-4edc-affd-4f127802b5c4 req-6a6a1412-2660-46a1-b873-54c7ed3dfbc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:41.942081 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-f493bbcd-e014-4edc-affd-4f127802b5c4 req-6a6a1412-2660-46a1-b873-54c7ed3dfbc0 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=e0e08679-82fe-47eb-90b6-49a1713fdaca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0872071 Nov 08 16:11:41.942845 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-add6ede0-1fd4-466f-b765-0d6c943db68b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:41.950055 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d4268f0-834e-4efd-8065-04f0d0794a61 req-4e2dc423-7730-4a27-ba62-56275346bb34 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:41.951744 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9d4268f0-834e-4efd-8065-04f0d0794a61 req-4e2dc423-7730-4a27-ba62-56275346bb34 service neutron] 10.222.0.25 "GET /v2.0/networks?tenant_id=4818358a827143eb9ace58a26713cdf0&shared=False HTTP/1.1" status: 200 len: 919 time: 0.3391817 Nov 08 16:11:41.953829 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-10b19368-fc14-4519-914e-2ce8e244c00e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Made reservation on behalf of f6e779f0506643d08d984c2971d5a71c for: {'port': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:11:41.957329 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-10b19368-fc14-4519-914e-2ce8e244c00e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:42.048717 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-add6ede0-1fd4-466f-b765-0d6c943db68b service neutron] Pushing event updated for resources: {'Port': ['ID=3e7ad14a-6975-4075-ac69-3a504ad24341,revision_number=2']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:42.114138 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.managers [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-add6ede0-1fd4-466f-b765-0d6c943db68b service neutron] Attempting to bind port 3e7ad14a-6975-4075-ac69-3a504ad24341 on host hv-cinder-81618 for vnic_type normal with profile {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:11:42.114476 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.managers [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-add6ede0-1fd4-466f-b765-0d6c943db68b service neutron] Attempting to bind port 3e7ad14a-6975-4075-ac69-3a504ad24341 by drivers openvswitch,hyperv on host hv-cinder-81618 at level 0 using segments [{'id': 'e14404ea-b710-490a-b578-a605dfc73350', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '2d5b5768-37f3-49a1-b451-2803f6f97429'}] {{(pid=101245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:11:42.114790 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-add6ede0-1fd4-466f-b765-0d6c943db68b service neutron] Attempting to bind port 3e7ad14a-6975-4075-ac69-3a504ad24341 on network 2d5b5768-37f3-49a1-b451-2803f6f97429 {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:11:42.119569 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-f493bbcd-e014-4edc-affd-4f127802b5c4 req-6657cd9d-5c21-453e-9de2-7d84f5fb7fb6 service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1411519 Nov 08 16:11:42.121486 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-add6ede0-1fd4-466f-b765-0d6c943db68b service neutron] Port 3e7ad14a-6975-4075-ac69-3a504ad24341 on network 2d5b5768-37f3-49a1-b451-2803f6f97429 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81618 {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 16:11:42.121818 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-add6ede0-1fd4-466f-b765-0d6c943db68b service neutron] Attempting to bind port 3e7ad14a-6975-4075-ac69-3a504ad24341 on network 2d5b5768-37f3-49a1-b451-2803f6f97429 {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:11:42.126788 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-add6ede0-1fd4-466f-b765-0d6c943db68b service neutron] Checking agent: {'id': '54bf9779-c14d-412a-90fc-96b4a6589d5a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81618', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'started_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 11, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:11:42.127116 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-add6ede0-1fd4-466f-b765-0d6c943db68b service neutron] Checking segment: {'id': 'e14404ea-b710-490a-b578-a605dfc73350', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '2d5b5768-37f3-49a1-b451-2803f6f97429'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:11:42.127484 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-add6ede0-1fd4-466f-b765-0d6c943db68b service neutron] Bound using segment: {'id': 'e14404ea-b710-490a-b578-a605dfc73350', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '2d5b5768-37f3-49a1-b451-2803f6f97429'} {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:11:42.127895 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.managers [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-add6ede0-1fd4-466f-b765-0d6c943db68b service neutron] Bound port: 3e7ad14a-6975-4075-ac69-3a504ad24341, host: hv-cinder-81618, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e14404ea-b710-490a-b578-a605dfc73350', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '2d5b5768-37f3-49a1-b451-2803f6f97429'}}] {{(pid=101245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:11:42.128236 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-add6ede0-1fd4-466f-b765-0d6c943db68b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:42.132015 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e0d4e8e6-63e9-4180-925e-70444df2d357 req-7d42b6bd-9ac5-4ef9-98dc-179c906a1a28 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 210 time: 0.1184320 Nov 08 16:11:42.253411 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97238200-efc4-4331-be75-ad46a5c453a6 req-226c3cdf-a953-4b1f-a97b-2b2c024f6135 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:42.254986 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-97238200-efc4-4331-be75-ad46a5c453a6 req-226c3cdf-a953-4b1f-a97b-2b2c024f6135 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 944 time: 0.2524827 Nov 08 16:11:42.302787 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d4268f0-834e-4efd-8065-04f0d0794a61 req-bd681d44-4144-4173-97a4-d4fb1eecf2bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:42.305359 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9d4268f0-834e-4efd-8065-04f0d0794a61 req-bd681d44-4144-4173-97a4-d4fb1eecf2bb service neutron] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3444421 Nov 08 16:11:42.416735 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eba49773-aad6-4d9a-b224-b01aaeacc0a6 req-0e961a76-7bde-4523-8cab-fd5325bd893a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:42.418265 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-eba49773-aad6-4d9a-b224-b01aaeacc0a6 req-0e961a76-7bde-4523-8cab-fd5325bd893a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 945 time: 0.2083788 Nov 08 16:11:42.431776 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-f493bbcd-e014-4edc-affd-4f127802b5c4 req-db84c637-72ed-41e6-9d67-f8ec82c1435d service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3006194 Nov 08 16:11:42.437683 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-97238200-efc4-4331-be75-ad46a5c453a6 req-40a5867c-5cf4-4d4c-9d19-c188bdd229d7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1603184 Nov 08 16:11:42.458585 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-10b19368-fc14-4519-914e-2ce8e244c00e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Allocated IP 172.20.0.4 (75fa9c3e-7bfe-490a-9118-221394c29646/8b248e51-4c70-4980-9452-c6b625bf96dd/f4784d76-6af7-4b31-a9f3-ee25c9087b51) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:11:42.465802 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-add6ede0-1fd4-466f-b765-0d6c943db68b service neutron] For port 3e7ad14a-6975-4075-ac69-3a504ad24341, host hv-cinder-81618, cleared binding levels {{(pid=101245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:11:42.471678 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-add6ede0-1fd4-466f-b765-0d6c943db68b service neutron] For port 3e7ad14a-6975-4075-ac69-3a504ad24341, host hv-cinder-81618, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=3e7ad14a-6975-4075-ac69-3a504ad24341,segment=NetworkSegment(e14404ea-b710-490a-b578-a605dfc73350),segment_id=e14404ea-b710-490a-b578-a605dfc73350)] {{(pid=101245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:11:42.479696 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-add6ede0-1fd4-466f-b765-0d6c943db68b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:42.501940 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-e3ae17a5-88b6-4a2f-b3c3-33b711103efc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:42.505489 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-e3ae17a5-88b6-4a2f-b3c3-33b711103efc service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=4818358a827143eb9ace58a26713cdf0&device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 1096 time: 0.1387169 Nov 08 16:11:42.536351 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-eba49773-aad6-4d9a-b224-b01aaeacc0a6 req-d4a8a3ba-0374-42bc-a2c0-4236e82c9aa1 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0984282 Nov 08 16:11:42.555597 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-add6ede0-1fd4-466f-b765-0d6c943db68b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:42.556107 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-add6ede0-1fd4-466f-b765-0d6c943db68b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for port, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:42.557693 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-add6ede0-1fd4-466f-b765-0d6c943db68b service neutron] 10.222.0.25 "PUT /v2.0/ports/3e7ad14a-6975-4075-ac69-3a504ad24341 HTTP/1.1" status: 200 len: 1094 time: 1.2516105 Nov 08 16:11:42.558336 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a3a953f3-d586-4495-b2d1-3c6e6cd89a52', 'tag': '3e7ad14a-6975-4075-ac69-3a504ad24341'}] {{(pid=101245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:11:42.561099 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9303bddee447de525cefc409d3d14f9dbe8ef1f21bfe9eb24fdef2609d4aa3c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1fafdcbb-305e-4cfa-af27-f04237dd8448" -d '{"events": [{"name": "network-changed", "server_uuid": "a3a953f3-d586-4495-b2d1-3c6e6cd89a52", "tag": "3e7ad14a-6975-4075-ac69-3a504ad24341"}]}' {{(pid=101245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:11:42.566801 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-add6ede0-1fd4-466f-b765-0d6c943db68b service neutron] Pushing event updated for resources: {'Port': ['ID=3e7ad14a-6975-4075-ac69-3a504ad24341,revision_number=3']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:42.604818 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:11:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4c29c979-bf54-44e1-87a1-62d2d8fc8da3 x-openstack-request-id: req-4c29c979-bf54-44e1-87a1-62d2d8fc8da3 {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:11:42.605109 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a3a953f3-d586-4495-b2d1-3c6e6cd89a52", "tag": "3e7ad14a-6975-4075-ac69-3a504ad24341", "status": "completed", "code": 200}]} {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:11:42.605515 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-4c29c979-bf54-44e1-87a1-62d2d8fc8da3 {{(pid=101245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:11:42.605940 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a3a953f3-d586-4495-b2d1-3c6e6cd89a52', 'tag': '3e7ad14a-6975-4075-ac69-3a504ad24341', 'status': 'completed', 'code': 200} Nov 08 16:11:42.734125 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fafdcbb-305e-4cfa-af27-f04237dd8448 req-e2059ef4-ad48-40c0-baf4-1ccbc7c35ff6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:42.736329 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-1fafdcbb-305e-4cfa-af27-f04237dd8448 req-e2059ef4-ad48-40c0-baf4-1ccbc7c35ff6 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=4818358a827143eb9ace58a26713cdf0&device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 1097 time: 0.0493383 Nov 08 16:11:42.863374 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-1447a4e3-7157-4506-9988-7052b8d0d737 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=17db566c-bf28-4091-b7f6-4ffa5f80c982 HTTP/1.1" status: 200 len: 217 time: 0.2043171 Nov 08 16:11:42.932826 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-10b19368-fc14-4519-914e-2ce8e244c00e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:42.941652 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-1ec83599-9059-4414-953c-d9c1d1a7f381 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:42.943137 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-1ec83599-9059-4414-953c-d9c1d1a7f381 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=6936707c-bd3f-4cd8-9462-a4af0ea16ed8 HTTP/1.1" status: 200 len: 858 time: 0.0672877 Nov 08 16:11:42.977082 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fafdcbb-305e-4cfa-af27-f04237dd8448 req-cc2bbfe2-2038-4a15-9a6c-636cbb89ad30 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:42.979683 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-1fafdcbb-305e-4cfa-af27-f04237dd8448 req-cc2bbfe2-2038-4a15-9a6c-636cbb89ad30 service neutron] 10.222.0.25 "GET /v2.0/networks?tenant_id=4818358a827143eb9ace58a26713cdf0&shared=False HTTP/1.1" status: 200 len: 919 time: 0.2334890 Nov 08 16:11:42.981878 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-409d258f-daef-44f8-a346-27012240dfce service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=2d5b5768-37f3-49a1-b451-2803f6f97429&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0311935 Nov 08 16:11:43.044568 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 60260) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:43.048722 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-10b19368-fc14-4519-914e-2ce8e244c00e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:43.130147 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10b19368-fc14-4519-914e-2ce8e244c00e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Pushing event updated for resources: {'Port': ['ID=f4784d76-6af7-4b31-a9f3-ee25c9087b51,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:43.152687 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['70c72d16-a0e9-49bb-b7b8-ef436d81a390'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:11:43.189545 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-10b19368-fc14-4519-914e-2ce8e244c00e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Network 75fa9c3e-7bfe-490a-9118-221394c29646 is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:11:43.202279 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-10b19368-fc14-4519-914e-2ce8e244c00e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:11:43.211449 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-750153de-1dd9-4a04-aaa6-c8574c1f8f6b req-b078c080-0c83-4961-8c57-d6dfe81b4fdc tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:43.212989 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-750153de-1dd9-4a04-aaa6-c8574c1f8f6b req-b078c080-0c83-4961-8c57-d6dfe81b4fdc tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 944 time: 0.2016757 Nov 08 16:11:43.223983 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-10b19368-fc14-4519-914e-2ce8e244c00e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:11:43.232857 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-10b19368-fc14-4519-914e-2ce8e244c00e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:43.234737 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-10b19368-fc14-4519-914e-2ce8e244c00e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:43.249048 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['4020a644-ef2e-4dd8-931a-cfccef4e7b15'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:11:43.284978 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fa89b6f-4c28-47e3-aea3-4e7df0126a4f req-b41b887a-30cc-42cc-aa5d-e024edecade4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:43.291203 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fafdcbb-305e-4cfa-af27-f04237dd8448 req-85a15920-2267-46df-8961-e854814cba91 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:43.295051 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-1fafdcbb-305e-4cfa-af27-f04237dd8448 req-85a15920-2267-46df-8961-e854814cba91 service neutron] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2992165 Nov 08 16:11:43.295348 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7fa89b6f-4c28-47e3-aea3-4e7df0126a4f req-b41b887a-30cc-42cc-aa5d-e024edecade4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.2488935 Nov 08 16:11:43.336838 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-10b19368-fc14-4519-914e-2ce8e244c00e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.8274257 Nov 08 16:11:43.343646 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-88236ee8-03df-414d-b256-25af93213f6c admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:43.371363 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-cd5188b8-a736-45ea-b202-e424256570b1 service neutron] Request body: {'port': {'device_id': 'b76ed94d-63f4-4597-be02-f3fc032b85aa', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81618'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:11:43.400261 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:43.425293 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-2d005907-f161-40cb-b514-4069502251f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:43.427145 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-2d005907-f161-40cb-b514-4069502251f0 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=4818358a827143eb9ace58a26713cdf0&device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 1097 time: 0.0704818 Nov 08 16:11:43.448326 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-c45cc46d-de58-4910-b2e1-853326d9e16b service neutron] 10.222.0.25 "GET /v2.0/networks/2d5b5768-37f3-49a1-b451-2803f6f97429?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3453002 Nov 08 16:11:43.465574 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7fa89b6f-4c28-47e3-aea3-4e7df0126a4f req-1d32c5e1-d5c8-47e6-a90f-17876140a4fb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1693625 Nov 08 16:11:43.486511 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-61a04166-e79e-4ba7-837e-c9e07ce462cd service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=3e7ad14a-6975-4075-ac69-3a504ad24341 HTTP/1.1" status: 200 len: 217 time: 0.0486398 Nov 08 16:11:43.500662 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-750153de-1dd9-4a04-aaa6-c8574c1f8f6b req-e994ce52-65af-41aa-9179-b1b7910a7803 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2417090 Nov 08 16:11:43.571635 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-88236ee8-03df-414d-b256-25af93213f6c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:43.576281 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-30540975-379a-4447-8d45-f53867ee08e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:43.578079 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-30540975-379a-4447-8d45-f53867ee08e4 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=6936707c-bd3f-4cd8-9462-a4af0ea16ed8 HTTP/1.1" status: 200 len: 858 time: 0.0829988 Nov 08 16:11:43.579279 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-88236ee8-03df-414d-b256-25af93213f6c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:43.621839 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-45d97b24-6e01-4286-9dae-b3cce3d59017 None None] Provisioning complete for port f4784d76-6af7-4b31-a9f3-ee25c9087b51 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:43.622200 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-45d97b24-6e01-4286-9dae-b3cce3d59017 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:43.638865 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-e28f2f02-310a-4fad-b8f4-89da11d9880f service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=2d5b5768-37f3-49a1-b451-2803f6f97429&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0472059 Nov 08 16:11:43.644311 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-cd5188b8-a736-45ea-b202-e424256570b1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:43.648363 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-88236ee8-03df-414d-b256-25af93213f6c admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=2f14489907db4c56b70acb29183859a9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6000936 Nov 08 16:11:43.652420 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 60274) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:43.654030 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88236ee8-03df-414d-b256-25af93213f6c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7a013636-1d7d-44b1-a144-3b4144458483,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:43.695901 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-45d97b24-6e01-4286-9dae-b3cce3d59017 None None] Port f4784d76-6af7-4b31-a9f3-ee25c9087b51 cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:11:43.742554 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-0ed8187a-3de0-4428-a722-203f7321d413 service neutron] 10.222.0.25 "GET /v2.0/networks/2d5b5768-37f3-49a1-b451-2803f6f97429?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0956233 Nov 08 16:11:43.755979 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17d12099-45d8-44fc-a0ae-8e8a6a586dca req-5427b1ad-2307-49af-9d6f-d9b0d5bf3ac9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:43.758098 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-17d12099-45d8-44fc-a0ae-8e8a6a586dca req-5427b1ad-2307-49af-9d6f-d9b0d5bf3ac9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 944 time: 0.1761522 Nov 08 16:11:43.774526 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c31cf270-103e-40db-ad13-ff6e7fe56a23 req-55bd0c28-414d-49a7-9e06-ff9435fbdfb8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:43.776086 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c31cf270-103e-40db-ad13-ff6e7fe56a23 req-55bd0c28-414d-49a7-9e06-ff9435fbdfb8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 931 time: 0.1974974 Nov 08 16:11:43.782169 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-3083dbb0-d20e-45ac-86e6-e161bf53e4a3 service neutron] 10.222.0.25 "GET /v2.0/networks/2d5b5768-37f3-49a1-b451-2803f6f97429?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3237588 Nov 08 16:11:43.844735 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-6e4196ec-4d9a-4763-90ef-520d495ea3b5 req-05c2e27f-fcf0-45ab-b983-0249c9f377cd service neutron] 10.222.0.25 "GET /v2.0/networks/2d5b5768-37f3-49a1-b451-2803f6f97429?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0945632 Nov 08 16:11:43.920260 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-bb6e08a5-54e7-4c86-a118-27505963051b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:43.950357 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:43.961062 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-17d12099-45d8-44fc-a0ae-8e8a6a586dca req-f4707ab7-f571-483d-8459-4476fd7cc319 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1956794 Nov 08 16:11:43.982473 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c31cf270-103e-40db-ad13-ff6e7fe56a23 req-40ad2993-0a06-4fd2-8295-621db75393e2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1802323 Nov 08 16:11:44.026872 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-bb6e08a5-54e7-4c86-a118-27505963051b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:44.156653 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25337a90-1230-4b43-8b73-9935a5d9f94b req-98685927-f06a-4757-89f8-35c550e8699d tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:44.158128 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-25337a90-1230-4b43-8b73-9935a5d9f94b req-98685927-f06a-4757-89f8-35c550e8699d tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 945 time: 0.1292987 Nov 08 16:11:44.175874 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-bb6e08a5-54e7-4c86-a118-27505963051b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:44.178930 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-bb6e08a5-54e7-4c86-a118-27505963051b admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:44.179961 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-bb6e08a5-54e7-4c86-a118-27505963051b admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/7a013636-1d7d-44b1-a144-3b4144458483 HTTP/1.1" status: 204 len: 168 time: 0.5251338 Nov 08 16:11:44.205570 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb6e08a5-54e7-4c86-a118-27505963051b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7a013636-1d7d-44b1-a144-3b4144458483,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:44.271471 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-25337a90-1230-4b43-8b73-9935a5d9f94b req-1fa9d477-4dac-4952-85a7-7676cff94351 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1039636 Nov 08 16:11:44.284328 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-cd5188b8-a736-45ea-b202-e424256570b1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f4784d76-6af7-4b31-a9f3-ee25c9087b51 {{(pid=101244) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:11:44.295851 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-cd5188b8-a736-45ea-b202-e424256570b1 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:44.310482 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.provisioning_blocks [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-cd5188b8-a736-45ea-b202-e424256570b1 service neutron] Transition to ACTIVE for port object f4784d76-6af7-4b31-a9f3-ee25c9087b51 will not be triggered until provisioned by entity L2. {{(pid=101244) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 16:11:44.315006 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-cd5188b8-a736-45ea-b202-e424256570b1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:44.371922 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd5188b8-a736-45ea-b202-e424256570b1 service neutron] Pushing event updated for resources: {'Port': ['ID=f4784d76-6af7-4b31-a9f3-ee25c9087b51,revision_number=2']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:44.405591 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-cd5188b8-a736-45ea-b202-e424256570b1 service neutron] Attempting to bind port f4784d76-6af7-4b31-a9f3-ee25c9087b51 on host hv-cinder-81618 for vnic_type normal with profile {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:11:44.406088 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-cd5188b8-a736-45ea-b202-e424256570b1 service neutron] Attempting to bind port f4784d76-6af7-4b31-a9f3-ee25c9087b51 by drivers openvswitch,hyperv on host hv-cinder-81618 at level 0 using segments [{'id': '7651dfae-d245-4d32-b379-dc243d043404', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646'}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:11:44.406574 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-cd5188b8-a736-45ea-b202-e424256570b1 service neutron] Attempting to bind port f4784d76-6af7-4b31-a9f3-ee25c9087b51 on network 75fa9c3e-7bfe-490a-9118-221394c29646 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:11:44.411412 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-cd5188b8-a736-45ea-b202-e424256570b1 service neutron] Port f4784d76-6af7-4b31-a9f3-ee25c9087b51 on network 75fa9c3e-7bfe-490a-9118-221394c29646 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81618 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 16:11:44.411936 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-cd5188b8-a736-45ea-b202-e424256570b1 service neutron] Attempting to bind port f4784d76-6af7-4b31-a9f3-ee25c9087b51 on network 75fa9c3e-7bfe-490a-9118-221394c29646 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:11:44.418240 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-cd5188b8-a736-45ea-b202-e424256570b1 service neutron] Checking agent: {'id': '54bf9779-c14d-412a-90fc-96b4a6589d5a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81618', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'started_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 11, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:11:44.418625 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-cd5188b8-a736-45ea-b202-e424256570b1 service neutron] Checking segment: {'id': '7651dfae-d245-4d32-b379-dc243d043404', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:11:44.419002 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-cd5188b8-a736-45ea-b202-e424256570b1 service neutron] Bound using segment: {'id': '7651dfae-d245-4d32-b379-dc243d043404', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646'} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:11:44.419446 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-cd5188b8-a736-45ea-b202-e424256570b1 service neutron] Bound port: f4784d76-6af7-4b31-a9f3-ee25c9087b51, host: hv-cinder-81618, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7651dfae-d245-4d32-b379-dc243d043404', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646'}}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:11:44.419765 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-cd5188b8-a736-45ea-b202-e424256570b1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:44.480929 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 60294) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:44.501246 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-2f0610de-b320-4fab-b410-01ec20e8bf4b admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:44.510973 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-cd5188b8-a736-45ea-b202-e424256570b1 service neutron] For port f4784d76-6af7-4b31-a9f3-ee25c9087b51, host hv-cinder-81618, cleared binding levels {{(pid=101244) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:11:44.527379 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-cd5188b8-a736-45ea-b202-e424256570b1 service neutron] For port f4784d76-6af7-4b31-a9f3-ee25c9087b51, host hv-cinder-81618, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=f4784d76-6af7-4b31-a9f3-ee25c9087b51,segment=NetworkSegment(7651dfae-d245-4d32-b379-dc243d043404),segment_id=7651dfae-d245-4d32-b379-dc243d043404)] {{(pid=101244) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:11:44.538027 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-cd5188b8-a736-45ea-b202-e424256570b1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:44.602752 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-cd5188b8-a736-45ea-b202-e424256570b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:44.603447 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-cd5188b8-a736-45ea-b202-e424256570b1 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:44.604915 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-cd5188b8-a736-45ea-b202-e424256570b1 service neutron] 10.222.0.25 "PUT /v2.0/ports/f4784d76-6af7-4b31-a9f3-ee25c9087b51 HTTP/1.1" status: 200 len: 1093 time: 1.2506061 Nov 08 16:11:44.626554 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b76ed94d-63f4-4597-be02-f3fc032b85aa', 'tag': 'f4784d76-6af7-4b31-a9f3-ee25c9087b51'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:11:44.628753 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cf533a4e-2930-49b0-97fe-ed0f8093cacf" -d '{"events": [{"name": "network-changed", "server_uuid": "b76ed94d-63f4-4597-be02-f3fc032b85aa", "tag": "f4784d76-6af7-4b31-a9f3-ee25c9087b51"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:11:44.710333 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd5188b8-a736-45ea-b202-e424256570b1 service neutron] Pushing event updated for resources: {'Port': ['ID=f4784d76-6af7-4b31-a9f3-ee25c9087b51,revision_number=3']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:44.751258 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a8a50ce-beaa-4137-9b38-2d6ce68d3fe3 req-dac335ac-5cfb-4219-95b1-2a88aaea3ee1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:44.752785 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6a8a50ce-beaa-4137-9b38-2d6ce68d3fe3 req-dac335ac-5cfb-4219-95b1-2a88aaea3ee1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.1620965 Nov 08 16:11:44.765094 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00bb79c1-36c8-4e6b-9952-ade12d0b25b0 req-07e59d95-3043-4ea1-88d2-ca0387fa827a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:44.767363 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-00bb79c1-36c8-4e6b-9952-ade12d0b25b0 req-07e59d95-3043-4ea1-88d2-ca0387fa827a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 944 time: 0.1755695 Nov 08 16:11:44.785855 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-2f0610de-b320-4fab-b410-01ec20e8bf4b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:44.806915 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-2f0610de-b320-4fab-b410-01ec20e8bf4b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:44.882870 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f0610de-b320-4fab-b410-01ec20e8bf4b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=87600e03-8c27-4135-a49d-74c766609008,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:44.894046 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-2f0610de-b320-4fab-b410-01ec20e8bf4b admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=fa51e26025b94a0a8d36d0d206249ef2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4092290 Nov 08 16:11:44.894264 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 60306) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:11:44.895122 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-00bb79c1-36c8-4e6b-9952-ade12d0b25b0 req-f0531d22-5793-4bf0-a06a-88d49af41ae6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1203985 Nov 08 16:11:44.898813 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6a8a50ce-beaa-4137-9b38-2d6ce68d3fe3 req-72487540-5acf-4fa6-9a5a-26bfecc87107 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1305337 Nov 08 16:11:44.941976 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:11:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b3dd0164-1ec2-4972-9afb-ae9568e8d64d x-openstack-request-id: req-b3dd0164-1ec2-4972-9afb-ae9568e8d64d {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:11:44.942266 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b76ed94d-63f4-4597-be02-f3fc032b85aa", "tag": "f4784d76-6af7-4b31-a9f3-ee25c9087b51", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:11:44.942516 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-b3dd0164-1ec2-4972-9afb-ae9568e8d64d {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:11:44.942906 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b76ed94d-63f4-4597-be02-f3fc032b85aa', 'tag': 'f4784d76-6af7-4b31-a9f3-ee25c9087b51', 'status': 'completed', 'code': 200} Nov 08 16:11:44.950895 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-180780f3-9ed4-482b-b11e-c64bfbd7a130 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:44.970650 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-180780f3-9ed4-482b-b11e-c64bfbd7a130 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:45.019859 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-180780f3-9ed4-482b-b11e-c64bfbd7a130 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:45.023047 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-180780f3-9ed4-482b-b11e-c64bfbd7a130 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:45.026186 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-180780f3-9ed4-482b-b11e-c64bfbd7a130 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/87600e03-8c27-4135-a49d-74c766609008 HTTP/1.1" status: 204 len: 168 time: 0.1312168 Nov 08 16:11:45.036575 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-180780f3-9ed4-482b-b11e-c64bfbd7a130 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=87600e03-8c27-4135-a49d-74c766609008,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:45.095227 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aaa6425-f040-4ebe-813a-42d922f7c824 req-0feea803-9229-40c4-967d-76ea79c40361 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:45.096850 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4aaa6425-f040-4ebe-813a-42d922f7c824 req-0feea803-9229-40c4-967d-76ea79c40361 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 944 time: 0.0585408 Nov 08 16:11:45.187534 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4596a76c-9ec8-424c-823a-cf33883454cd req-12972aac-dbf4-4b9d-8fe6-257de8c71941 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:45.190216 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4596a76c-9ec8-424c-823a-cf33883454cd req-12972aac-dbf4-4b9d-8fe6-257de8c71941 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 943 time: 0.0923607 Nov 08 16:11:45.198234 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4aaa6425-f040-4ebe-813a-42d922f7c824 req-694f5d9a-39ba-4828-9237-4fd5c55e2c09 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0914719 Nov 08 16:11:45.243631 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4596a76c-9ec8-424c-823a-cf33883454cd req-602bec46-e8b4-4484-adb8-504f25ebc9c2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441136 Nov 08 16:11:45.384924 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d45277d-ef0d-4b02-8919-b45c29ea9798 req-c57a5def-e101-4077-aded-b6033273ba0c tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:45.386502 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8d45277d-ef0d-4b02-8919-b45c29ea9798 req-c57a5def-e101-4077-aded-b6033273ba0c tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 945 time: 0.0478120 Nov 08 16:11:45.433902 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8d45277d-ef0d-4b02-8919-b45c29ea9798 req-88e6f322-d489-487e-baa5-a2b357bbb873 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409150 Nov 08 16:11:46.050694 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca30b9fc-8b0f-4a51-9a26-e896e5e83c8a req-3a5964d9-e517-445a-8f4e-d5b2a5daaca9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:46.052168 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ca30b9fc-8b0f-4a51-9a26-e896e5e83c8a req-3a5964d9-e517-445a-8f4e-d5b2a5daaca9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0718815 Nov 08 16:11:46.060332 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-225b4516-94e5-4e14-99d5-67098a35cd08 req-8dff9309-5780-4ce0-92b5-74b8f74dfc55 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:46.062025 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-225b4516-94e5-4e14-99d5-67098a35cd08 req-8dff9309-5780-4ce0-92b5-74b8f74dfc55 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 944 time: 0.0950181 Nov 08 16:11:46.139963 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ca30b9fc-8b0f-4a51-9a26-e896e5e83c8a req-e5aa0e24-427e-40f8-b7ab-44f775b30bff tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0769951 Nov 08 16:11:46.144296 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-225b4516-94e5-4e14-99d5-67098a35cd08 req-08faeae1-920e-4900-abcc-a614bba0ab09 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0755625 Nov 08 16:11:46.190499 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:46.311610 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dba27b7f-c0b2-432e-89c0-0d00d3dfcc0c req-4799990d-5de7-4d26-ba9e-ae7950cfaef5 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:46.313126 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dba27b7f-c0b2-432e-89c0-0d00d3dfcc0c req-4799990d-5de7-4d26-ba9e-ae7950cfaef5 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 944 time: 0.0493798 Nov 08 16:11:46.391734 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5dc9f3c-9600-4656-b2d0-3efe3df8ed7c req-cfd9f95e-c0ab-459a-94bd-2db20d8a3bba tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:46.393209 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d5dc9f3c-9600-4656-b2d0-3efe3df8ed7c req-cfd9f95e-c0ab-459a-94bd-2db20d8a3bba tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 943 time: 0.0792229 Nov 08 16:11:46.396300 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dba27b7f-c0b2-432e-89c0-0d00d3dfcc0c req-83d3f1f3-27c9-442e-8056-0c3a1149f6b2 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0737898 Nov 08 16:11:46.440208 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d5dc9f3c-9600-4656-b2d0-3efe3df8ed7c req-47243d05-2aba-45df-b631-76c2935641a5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410087 Nov 08 16:11:46.545933 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7533c996-ca8e-4542-bbc5-11ea962b4670 req-3d944de6-270e-4ba1-bc20-23316293dca9 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:46.547372 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7533c996-ca8e-4542-bbc5-11ea962b4670 req-3d944de6-270e-4ba1-bc20-23316293dca9 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 945 time: 0.0474803 Nov 08 16:11:46.593373 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7533c996-ca8e-4542-bbc5-11ea962b4670 req-94d8adb5-4759-4af6-bc56-a2ca25060963 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394974 Nov 08 16:11:47.293319 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74bcc7a7-d10a-4cbe-b87e-bcc34c93357f req-c75fd608-cd1b-4e83-8239-a2b02d0a056e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:47.294762 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-74bcc7a7-d10a-4cbe-b87e-bcc34c93357f req-c75fd608-cd1b-4e83-8239-a2b02d0a056e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 944 time: 0.0760031 Nov 08 16:11:47.302739 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3be997b6-70d2-4337-af2a-9cfad3b7aa7d req-57a509fa-69a3-4485-8a82-d137bf7758e3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:47.304575 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3be997b6-70d2-4337-af2a-9cfad3b7aa7d req-57a509fa-69a3-4485-8a82-d137bf7758e3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0840278 Nov 08 16:11:47.398799 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-74bcc7a7-d10a-4cbe-b87e-bcc34c93357f req-66648693-17a8-438c-9c80-588ac31a7783 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0931973 Nov 08 16:11:47.402515 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3be997b6-70d2-4337-af2a-9cfad3b7aa7d req-5cbcf3ff-7226-4136-a131-7e4de5324618 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0916078 Nov 08 16:11:47.414323 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf533a4e-2930-49b0-97fe-ed0f8093cacf req-c8f84cf7-c4e7-4b7d-8ac1-243632accea6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:47.415667 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cf533a4e-2930-49b0-97fe-ed0f8093cacf req-c8f84cf7-c4e7-4b7d-8ac1-243632accea6 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=f6e779f0506643d08d984c2971d5a71c&device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 1096 time: 0.0716753 Nov 08 16:11:47.510071 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-061cabd5-b55a-4e4a-8ca6-b11d18073d8f req-78ae6c36-b692-40db-a632-233fd7d06ee2 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:47.511513 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-061cabd5-b55a-4e4a-8ca6-b11d18073d8f req-78ae6c36-b692-40db-a632-233fd7d06ee2 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 944 time: 0.0501518 Nov 08 16:11:47.583274 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9395e87a-597e-4126-940a-6a985af23f47 req-a4c9ceb8-85f6-4598-8594-d94e9753fd82 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:47.584724 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9395e87a-597e-4126-940a-6a985af23f47 req-a4c9ceb8-85f6-4598-8594-d94e9753fd82 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 943 time: 0.0723875 Nov 08 16:11:47.588203 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-061cabd5-b55a-4e4a-8ca6-b11d18073d8f req-245a07bb-22a0-44e7-9d73-08f46abc7b7c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0681927 Nov 08 16:11:47.631623 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9395e87a-597e-4126-940a-6a985af23f47 req-6728a1b4-077c-48ec-8fff-8508486e1ee1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405157 Nov 08 16:11:47.703907 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ebe809a-0299-4c69-887c-84befd440d63 req-e3008e39-a4b6-4b2f-8411-b70342c0f277 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:47.705233 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1ebe809a-0299-4c69-887c-84befd440d63 req-e3008e39-a4b6-4b2f-8411-b70342c0f277 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 945 time: 0.0465531 Nov 08 16:11:47.754011 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1ebe809a-0299-4c69-887c-84befd440d63 req-65652772-f446-45ff-af73-26b9d6c7641d tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423884 Nov 08 16:11:48.536251 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86182f17-1b67-452c-a8ee-9698d48e7694 req-e4f1f92e-55c3-4121-81c4-071c638539db tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:48.538206 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-86182f17-1b67-452c-a8ee-9698d48e7694 req-e4f1f92e-55c3-4121-81c4-071c638539db tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 944 time: 0.0740774 Nov 08 16:11:48.545385 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3869f923-6d69-4764-b680-aaf1b80676b7 req-87826b37-64a5-4c0b-9376-4b6ca9c26935 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:48.546742 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3869f923-6d69-4764-b680-aaf1b80676b7 req-87826b37-64a5-4c0b-9376-4b6ca9c26935 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0741971 Nov 08 16:11:48.613990 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-86182f17-1b67-452c-a8ee-9698d48e7694 req-eee758eb-83e1-453f-b739-04789c690d9e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0663166 Nov 08 16:11:48.618608 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3869f923-6d69-4764-b680-aaf1b80676b7 req-48c10a66-1df8-4174-9a1f-5de412ec025c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0655415 Nov 08 16:11:48.744481 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62fe4b89-e191-46f6-a02e-71c4c6526449 req-d109f9d5-681f-4066-99cf-85b5dacc3925 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:48.745840 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-62fe4b89-e191-46f6-a02e-71c4c6526449 req-d109f9d5-681f-4066-99cf-85b5dacc3925 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 944 time: 0.0774229 Nov 08 16:11:48.757304 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f59f4f0e-6635-466d-acf8-8b30dbc5b28a req-d8dceff4-fbb0-482c-8c3b-323d1006159f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:48.758719 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f59f4f0e-6635-466d-acf8-8b30dbc5b28a req-d8dceff4-fbb0-482c-8c3b-323d1006159f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 943 time: 0.0621908 Nov 08 16:11:48.827111 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-62fe4b89-e191-46f6-a02e-71c4c6526449 req-87d146aa-1b1d-4042-afe3-62d2dc68da72 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0674760 Nov 08 16:11:48.832398 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f59f4f0e-6635-466d-acf8-8b30dbc5b28a req-31de27dd-c4c1-4040-ab59-3debbd9e90de tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0672801 Nov 08 16:11:48.935171 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-813c6b6a-796a-4857-b8e8-658416264f51 req-38a88243-09af-4a16-8776-38f8086bbb3a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:48.936597 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-813c6b6a-796a-4857-b8e8-658416264f51 req-38a88243-09af-4a16-8776-38f8086bbb3a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 945 time: 0.0486207 Nov 08 16:11:49.160134 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-813c6b6a-796a-4857-b8e8-658416264f51 req-3ef4e35b-fa6d-4c60-b9a1-f15495e737de tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2176468 Nov 08 16:11:49.228528 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf533a4e-2930-49b0-97fe-ed0f8093cacf req-5cd76c40-85dd-4849-ac3b-f36c14089bd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:49.229985 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cf533a4e-2930-49b0-97fe-ed0f8093cacf req-5cd76c40-85dd-4849-ac3b-f36c14089bd4 service neutron] 10.222.0.25 "GET /v2.0/networks?tenant_id=f6e779f0506643d08d984c2971d5a71c&shared=False HTTP/1.1" status: 200 len: 911 time: 0.0941856 Nov 08 16:11:49.325362 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf533a4e-2930-49b0-97fe-ed0f8093cacf req-16735653-1799-42bc-86c0-d63730010e7f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:49.326815 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cf533a4e-2930-49b0-97fe-ed0f8093cacf req-16735653-1799-42bc-86c0-d63730010e7f service neutron] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0853477 Nov 08 16:11:49.403506 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-7eecb330-efaf-486c-90a9-5dd3dda126e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:49.404839 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-7eecb330-efaf-486c-90a9-5dd3dda126e5 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=f6e779f0506643d08d984c2971d5a71c&device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 1096 time: 0.0379953 Nov 08 16:11:49.445362 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-c3ead019-ce47-424e-a639-66caaf2f952c service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f4784d76-6af7-4b31-a9f3-ee25c9087b51 HTTP/1.1" status: 200 len: 217 time: 0.0317764 Nov 08 16:11:49.496632 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-73ab42ee-3b4f-42e0-9a5c-678ae8817400 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:49.498014 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-73ab42ee-3b4f-42e0-9a5c-678ae8817400 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=8b248e51-4c70-4980-9452-c6b625bf96dd HTTP/1.1" status: 200 len: 849 time: 0.0443580 Nov 08 16:11:49.541532 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-14106c0a-5034-4b92-92f2-51a3fb1421b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:49.542957 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-14106c0a-5034-4b92-92f2-51a3fb1421b7 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=75fa9c3e-7bfe-490a-9118-221394c29646&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0372100 Nov 08 16:11:49.632487 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-e5548783-3c71-4949-990b-32e549a5a2f4 service neutron] 10.222.0.25 "GET /v2.0/networks/75fa9c3e-7bfe-490a-9118-221394c29646?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0777013 Nov 08 16:11:49.794136 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0554df11-6570-4fd8-9be8-e07106dc8eeb req-d9f60673-66bb-41a1-bef7-641bf547a06a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:49.795586 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0554df11-6570-4fd8-9be8-e07106dc8eeb req-d9f60673-66bb-41a1-bef7-641bf547a06a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 944 time: 0.1087744 Nov 08 16:11:49.805361 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22bf5d16-5d5d-4a2e-b3a9-71d59d11f42e req-e26058ac-8ee0-4cc9-bed0-0ab8bae9861a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:49.806928 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-22bf5d16-5d5d-4a2e-b3a9-71d59d11f42e req-e26058ac-8ee0-4cc9-bed0-0ab8bae9861a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.1172640 Nov 08 16:11:49.810703 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3b5ab196-ee08-45e2-aa43-7be6542b11c0 req-fec72e84-f33c-4abd-bd42-dd67a9aac58a service neutron] 10.222.0.25 "GET /v2.0/networks/75fa9c3e-7bfe-490a-9118-221394c29646?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1698811 Nov 08 16:11:49.884525 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0554df11-6570-4fd8-9be8-e07106dc8eeb req-8e8bc6ec-b6ae-4fef-89a8-62555662badd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0764558 Nov 08 16:11:49.896032 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-22bf5d16-5d5d-4a2e-b3a9-71d59d11f42e req-7fdcf468-32e4-4506-abe7-c38f9a7bafb7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0771825 Nov 08 16:11:50.024230 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50fb9788-7b65-4ba5-b71d-f72e7b838a94 req-9d906d30-6625-48d2-acc0-d40d03159b42 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:50.025665 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-50fb9788-7b65-4ba5-b71d-f72e7b838a94 req-9d906d30-6625-48d2-acc0-d40d03159b42 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 943 time: 0.0770974 Nov 08 16:11:50.033582 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc592bf4-be7e-4301-b699-5883dbc21736 req-a082cf79-1daf-4810-bff5-1a4b74af0384 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:50.034934 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bc592bf4-be7e-4301-b699-5883dbc21736 req-a082cf79-1daf-4810-bff5-1a4b74af0384 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 944 time: 0.0776587 Nov 08 16:11:50.103516 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bc592bf4-be7e-4301-b699-5883dbc21736 req-1fa4abc9-6e68-42ea-a810-052fe253451c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0621302 Nov 08 16:11:50.106738 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-50fb9788-7b65-4ba5-b71d-f72e7b838a94 req-a85ce9d5-cd07-4821-8bb8-2160884b0493 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0709355 Nov 08 16:11:50.273173 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fa6da1c-203b-4c2e-8ae2-60717eb0eeb1 req-c1065dba-8a11-4af6-acfe-bc7beff8c7fa tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:50.274677 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2fa6da1c-203b-4c2e-8ae2-60717eb0eeb1 req-c1065dba-8a11-4af6-acfe-bc7beff8c7fa tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 945 time: 0.0483809 Nov 08 16:11:50.322949 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2fa6da1c-203b-4c2e-8ae2-60717eb0eeb1 req-c5171a42-5a5a-4987-94cb-8e52b2fc1bfd tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421448 Nov 08 16:11:51.027279 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc187f08-4f88-4732-9cd0-2bab26b4759b req-7ac6da2e-f846-473e-a558-65e2c2d74e54 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:51.028764 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cc187f08-4f88-4732-9cd0-2bab26b4759b req-7ac6da2e-f846-473e-a558-65e2c2d74e54 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 944 time: 0.0787597 Nov 08 16:11:51.041178 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2a3762f-65fb-4d45-9225-5ef9f49a7e74 req-14937efb-3525-4219-973b-1102c166e98a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:51.042590 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d2a3762f-65fb-4d45-9225-5ef9f49a7e74 req-14937efb-3525-4219-973b-1102c166e98a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0686796 Nov 08 16:11:51.110635 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cc187f08-4f88-4732-9cd0-2bab26b4759b req-7ef30d9b-9a79-45ae-9367-355544db93a6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0671239 Nov 08 16:11:51.114844 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d2a3762f-65fb-4d45-9225-5ef9f49a7e74 req-4b4b002d-120a-44e4-8fae-250d797a4b91 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0658789 Nov 08 16:11:51.245766 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7837fe4f-f865-4d8f-ae72-45b642c6d077 req-342545ba-5caa-4036-b75f-32ba1d139293 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:51.247229 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7837fe4f-f865-4d8f-ae72-45b642c6d077 req-342545ba-5caa-4036-b75f-32ba1d139293 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 944 time: 0.0764375 Nov 08 16:11:51.254697 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05297358-3304-46c1-86c4-e7107127226f req-ed38a765-a4db-4342-8a3d-0bff0097bc7f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:51.256051 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-05297358-3304-46c1-86c4-e7107127226f req-ed38a765-a4db-4342-8a3d-0bff0097bc7f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 943 time: 0.0834033 Nov 08 16:11:51.323613 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7837fe4f-f865-4d8f-ae72-45b642c6d077 req-27d14791-5f0e-4d3f-8171-2ac98bb5734c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0666533 Nov 08 16:11:51.327742 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-05297358-3304-46c1-86c4-e7107127226f req-feee2a49-982e-4be8-9534-4cca28aba1d0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0653043 Nov 08 16:11:51.440309 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e03107f1-81e7-4970-9b4f-0eeee4c066ba req-1960f16d-1dec-4663-9258-b48304de4c64 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:51.441858 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e03107f1-81e7-4970-9b4f-0eeee4c066ba req-1960f16d-1dec-4663-9258-b48304de4c64 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 945 time: 0.0476646 Nov 08 16:11:51.488368 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e03107f1-81e7-4970-9b4f-0eeee4c066ba req-67f7ce0b-f207-49c7-bd8c-08dd4bd86297 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400257 Nov 08 16:11:52.251262 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfae1d42-2bcb-4513-b5e8-8842054b2e15 req-9163eec8-4747-43b4-b478-31c3680e511f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:52.252633 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bfae1d42-2bcb-4513-b5e8-8842054b2e15 req-9163eec8-4747-43b4-b478-31c3680e511f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 944 time: 0.0767486 Nov 08 16:11:52.260690 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aeb72c8-d10b-4106-a747-30a681591470 req-6392199b-d2ad-4802-aafb-ca2e72fac6bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:52.262053 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7aeb72c8-d10b-4106-a747-30a681591470 req-6392199b-d2ad-4802-aafb-ca2e72fac6bd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0769942 Nov 08 16:11:52.331076 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bfae1d42-2bcb-4513-b5e8-8842054b2e15 req-546c3b98-a78a-46a5-a272-73747fa192f3 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0681167 Nov 08 16:11:52.334782 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7aeb72c8-d10b-4106-a747-30a681591470 req-e49d21cc-30d0-4a85-a63a-c7ba0c43feda tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0657897 Nov 08 16:11:52.471014 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0729f4b0-a7d6-4dd1-8bc3-01052cafc3e1 req-373a35ce-6227-4bd7-a799-3424a8270665 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:52.472471 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0729f4b0-a7d6-4dd1-8bc3-01052cafc3e1 req-373a35ce-6227-4bd7-a799-3424a8270665 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 944 time: 0.0775733 Nov 08 16:11:52.480542 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a4a6cd6-0048-407d-9dfd-9d58b086cc1e req-b7a42143-d462-43c5-823b-18d8010694b5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:52.481920 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1a4a6cd6-0048-407d-9dfd-9d58b086cc1e req-b7a42143-d462-43c5-823b-18d8010694b5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 943 time: 0.0774486 Nov 08 16:11:52.548584 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0729f4b0-a7d6-4dd1-8bc3-01052cafc3e1 req-579321a2-2eb9-49d9-aa91-885f2eb0a65c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0656726 Nov 08 16:11:52.556250 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1a4a6cd6-0048-407d-9dfd-9d58b086cc1e req-21bf53cf-e76a-4f3d-a17c-d529adb94367 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0678988 Nov 08 16:11:52.648245 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8ecfc28-bb86-4583-8eb3-e13431de93e2 req-b968daf3-c2a7-4de5-93c5-f932fbb0c273 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:52.649681 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f8ecfc28-bb86-4583-8eb3-e13431de93e2 req-b968daf3-c2a7-4de5-93c5-f932fbb0c273 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 945 time: 0.0474970 Nov 08 16:11:52.694262 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f8ecfc28-bb86-4583-8eb3-e13431de93e2 req-2e2376b8-0ea2-45df-9ac3-92be1dd4d6ab tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389962 Nov 08 16:11:53.481273 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3cab0c9-ac65-4b88-a654-cd9bec9cb043 req-c3a3b0b1-a2e9-4bb6-abe5-db679fb47a6b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:53.482765 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b3cab0c9-ac65-4b88-a654-cd9bec9cb043 req-c3a3b0b1-a2e9-4bb6-abe5-db679fb47a6b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0667355 Nov 08 16:11:53.489985 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5872069b-3ae8-4754-8bf6-dd95fdfc07b6 req-0c771ec5-e1c4-4076-9a69-5e8353fe207e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:53.491339 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5872069b-3ae8-4754-8bf6-dd95fdfc07b6 req-0c771ec5-e1c4-4076-9a69-5e8353fe207e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 944 time: 0.0863333 Nov 08 16:11:53.560077 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b3cab0c9-ac65-4b88-a654-cd9bec9cb043 req-c9b90efd-7706-48a8-9f7f-45a5b9fc8989 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0678275 Nov 08 16:11:53.563506 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5872069b-3ae8-4754-8bf6-dd95fdfc07b6 req-0bd51a60-4a78-4fb0-a939-a07209759be2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0657969 Nov 08 16:11:53.692591 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b33bfe5-07af-46c7-a1d3-b069b6c9b6e0 req-beacec46-aab8-4bea-b499-2124cad9512c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:53.694038 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4b33bfe5-07af-46c7-a1d3-b069b6c9b6e0 req-beacec46-aab8-4bea-b499-2124cad9512c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 944 time: 0.0769343 Nov 08 16:11:53.702073 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67030f89-ea37-454e-a02f-ded6ac155b24 req-db78809e-d4aa-4f62-8ba9-dea2d47fb392 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:53.703415 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-67030f89-ea37-454e-a02f-ded6ac155b24 req-db78809e-d4aa-4f62-8ba9-dea2d47fb392 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 943 time: 0.0763428 Nov 08 16:11:53.773072 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4b33bfe5-07af-46c7-a1d3-b069b6c9b6e0 req-d382712b-0c04-4c25-b7de-283ec9784693 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0687342 Nov 08 16:11:53.776236 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-67030f89-ea37-454e-a02f-ded6ac155b24 req-0680e024-0080-41dc-9c89-76ceef717fbc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0664580 Nov 08 16:11:53.872441 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cc28d5e-15fb-4582-9a26-b1a8488231a7 req-2a1457da-2678-4d21-9a55-bb4cdfb541f5 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:53.874160 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7cc28d5e-15fb-4582-9a26-b1a8488231a7 req-2a1457da-2678-4d21-9a55-bb4cdfb541f5 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 945 time: 0.0469933 Nov 08 16:11:53.918934 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7cc28d5e-15fb-4582-9a26-b1a8488231a7 req-1061e7bc-9ad4-49cc-9a96-176d429505ef tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390737 Nov 08 16:11:54.702963 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6885ef46-e5e9-4f96-bad0-d02fa82033ab req-76c286a3-12e1-4fb0-be62-a811ae79a6ee tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:54.704312 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6885ef46-e5e9-4f96-bad0-d02fa82033ab req-76c286a3-12e1-4fb0-be62-a811ae79a6ee tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 944 time: 0.0761247 Nov 08 16:11:54.712839 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c1df1d4-ceb2-4d9a-8d52-ddba1da43f3c req-4e9139d3-a0f0-4ebe-8195-53941c3c6c00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:54.714193 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8c1df1d4-ceb2-4d9a-8d52-ddba1da43f3c req-4e9139d3-a0f0-4ebe-8195-53941c3c6c00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0841987 Nov 08 16:11:54.780367 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6885ef46-e5e9-4f96-bad0-d02fa82033ab req-33f28f55-d739-4477-bb83-d4d55639f10e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0652661 Nov 08 16:11:54.787912 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8c1df1d4-ceb2-4d9a-8d52-ddba1da43f3c req-5de0a9fe-4227-40e7-a826-f85762de0d27 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0673802 Nov 08 16:11:54.917066 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb05582d-4f70-4e85-abe0-8bd6c7886914 req-3e9a615f-8dbd-4a9a-af50-57d1e52bca51 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:54.918545 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fb05582d-4f70-4e85-abe0-8bd6c7886914 req-3e9a615f-8dbd-4a9a-af50-57d1e52bca51 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 944 time: 0.0750353 Nov 08 16:11:54.929588 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62114888-4851-40f3-b52f-19d45e81ae3b req-421f509c-48af-4ca3-8f55-714476ec1c10 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:54.930971 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-62114888-4851-40f3-b52f-19d45e81ae3b req-421f509c-48af-4ca3-8f55-714476ec1c10 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 943 time: 0.0856271 Nov 08 16:11:55.000304 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fb05582d-4f70-4e85-abe0-8bd6c7886914 req-7b669a64-8bda-48d9-af8d-dd6f9da32538 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0682318 Nov 08 16:11:55.003348 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-62114888-4851-40f3-b52f-19d45e81ae3b req-2722fa74-606c-4b69-aba5-bca17bcc2256 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0659764 Nov 08 16:11:55.101316 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5960bfa2-1f33-4e92-b4a0-3b014632e09d req-7af85a7c-67d9-4c92-9b2c-210c6ce5fc29 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:55.102807 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5960bfa2-1f33-4e92-b4a0-3b014632e09d req-7af85a7c-67d9-4c92-9b2c-210c6ce5fc29 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 945 time: 0.0484276 Nov 08 16:11:55.148196 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5960bfa2-1f33-4e92-b4a0-3b014632e09d req-d4dd3406-ed2a-4694-859f-e9c81fcac708 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396194 Nov 08 16:11:55.280801 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device fbefda08-fc7a-42a0-b714-6dea3d8a5161 details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:11:55.369610 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port fbefda08-fc7a-42a0-b714-6dea3d8a5161, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=fbefda08-fc7a-42a0-b714-6dea3d8a5161,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:11:55.381238 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': 'fbefda08-fc7a-42a0-b714-6dea3d8a5161', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'port_id': 'fbefda08-fc7a-42a0-b714-6dea3d8a5161', 'mac_address': 'fa:16:3e:13:3c:f6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 188, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:11:55.419325 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:55.431348 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fbefda08-fc7a-42a0-b714-6dea3d8a5161 {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:11:55.450048 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port fbefda08-fc7a-42a0-b714-6dea3d8a5161, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=fbefda08-fc7a-42a0-b714-6dea3d8a5161,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:11:55.455378 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:55.501473 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=fbefda08-fc7a-42a0-b714-6dea3d8a5161,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:55.596769 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:11:55.923354 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01967971-468f-4a7c-9a9c-7fd5adb5d757 req-2372d535-b6bf-4bfc-8971-65ab04e0aed4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:55.924715 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-01967971-468f-4a7c-9a9c-7fd5adb5d757 req-2372d535-b6bf-4bfc-8971-65ab04e0aed4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 944 time: 0.0771718 Nov 08 16:11:55.931900 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbfc3df8-5386-4e33-a579-23b91d8e4f10 req-4f0424b8-e5ac-4098-af2d-626a0ce1f98e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:55.933208 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bbfc3df8-5386-4e33-a579-23b91d8e4f10 req-4f0424b8-e5ac-4098-af2d-626a0ce1f98e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 944 time: 0.0752859 Nov 08 16:11:56.001071 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-01967971-468f-4a7c-9a9c-7fd5adb5d757 req-f493e7bb-e633-478e-9792-81a189145cf9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0669360 Nov 08 16:11:56.004411 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bbfc3df8-5386-4e33-a579-23b91d8e4f10 req-279e8420-65ed-4c96-9fb0-faf594dff720 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0648155 Nov 08 16:11:56.145745 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-868b4484-ac50-406d-baf0-6570a330d9f9 req-8cfcf157-feee-427a-b694-770929764588 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:56.147279 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-868b4484-ac50-406d-baf0-6570a330d9f9 req-8cfcf157-feee-427a-b694-770929764588 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 943 time: 0.0785930 Nov 08 16:11:56.154451 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ff135d7-bb23-4469-b6f2-2e236796b364 req-ca2deb7f-e461-465b-9cbf-a43deaa53418 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:56.155758 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8ff135d7-bb23-4469-b6f2-2e236796b364 req-ca2deb7f-e461-465b-9cbf-a43deaa53418 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 944 time: 0.0785832 Nov 08 16:11:56.221645 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-868b4484-ac50-406d-baf0-6570a330d9f9 req-2a37ee5f-c53c-450e-b941-ec3994b35816 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0649698 Nov 08 16:11:56.229204 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8ff135d7-bb23-4469-b6f2-2e236796b364 req-6fa08558-b199-4985-91b7-606b1928adbf tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0667784 Nov 08 16:11:56.306108 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['fbefda08-fc7a-42a0-b714-6dea3d8a5161'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:11:56.324455 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-921147ba-dbf9-4eae-b3a5-862dbbc3b55d req-b19b2862-c6d1-482b-aac2-0f36b3f221da tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:56.325942 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-921147ba-dbf9-4eae-b3a5-862dbbc3b55d req-b19b2862-c6d1-482b-aac2-0f36b3f221da tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 945 time: 0.0476093 Nov 08 16:11:56.372859 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-921147ba-dbf9-4eae-b3a5-862dbbc3b55d req-ddb888f0-4649-440d-9e88-38ede86bd8d0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401447 Nov 08 16:11:57.242937 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 3e7ad14a-6975-4075-ac69-3a504ad24341 details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:11:57.247639 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 70c72d16-a0e9-49bb-b7b8-ef436d81a390 up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:11:57.304531 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bb0095d-6058-42e9-9f2c-0a902574bf3f req-23fc551c-54dd-409b-904d-e0a2b2616662 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:57.310502 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5bb0095d-6058-42e9-9f2c-0a902574bf3f req-23fc551c-54dd-409b-904d-e0a2b2616662 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 944 time: 0.2448628 Nov 08 16:11:57.340352 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32b03fa0-846a-4f20-9567-9f26136fab94 req-de2687ad-96f2-437d-b753-f57fb36789a4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:57.341883 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-32b03fa0-846a-4f20-9567-9f26136fab94 req-de2687ad-96f2-437d-b753-f57fb36789a4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 944 time: 0.2659812 Nov 08 16:11:57.392273 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning for port 70c72d16-a0e9-49bb-b7b8-ef436d81a390 completed by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 16:11:57.410851 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port 70c72d16-a0e9-49bb-b7b8-ef436d81a390 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:57.411202 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:57.415214 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5bb0095d-6058-42e9-9f2c-0a902574bf3f req-f0d4ba7d-ff90-42a5-99fe-f475624561e6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1037924 Nov 08 16:11:57.456610 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-32b03fa0-846a-4f20-9567-9f26136fab94 req-436d28b9-888e-4cc5-ba60-7c75dfca7829 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0975978 Nov 08 16:11:57.489407 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 3e7ad14a-6975-4075-ac69-3a504ad24341, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=3e7ad14a-6975-4075-ac69-3a504ad24341,segment=NetworkSegment(e14404ea-b710-490a-b578-a605dfc73350),segment_id=e14404ea-b710-490a-b578-a605dfc73350)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:11:57.526621 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': '3e7ad14a-6975-4075-ac69-3a504ad24341', 'network_id': '2d5b5768-37f3-49a1-b451-2803f6f97429', 'port_id': '3e7ad14a-6975-4075-ac69-3a504ad24341', 'mac_address': 'fa:16:3e:a4:70:82', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 164, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6936707c-bd3f-4cd8-9462-a4af0ea16ed8', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:11:57.564616 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:57.598890 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:57.601535 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dab7017f-059a-4de6-8a6e-51f1fc037b14 req-34be11b6-1277-4fd5-aaf4-e7282f88eaa8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:57.605089 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ec4f96b9-4128-4da6-9880-95a0f72fd4e2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '70c72d16-a0e9-49bb-b7b8-ef436d81a390'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:11:57.608147 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dab7017f-059a-4de6-8a6e-51f1fc037b14 req-34be11b6-1277-4fd5-aaf4-e7282f88eaa8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 943 time: 0.1195133 Nov 08 16:11:57.671731 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-537c8e29-ee88-4c29-ad5d-b6cebe7cc37c req-bb0e38d2-aaa4-4e63-8363-37cb0f4766b9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:57.680421 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-537c8e29-ee88-4c29-ad5d-b6cebe7cc37c req-bb0e38d2-aaa4-4e63-8363-37cb0f4766b9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 944 time: 0.1359780 Nov 08 16:11:57.727238 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dab7017f-059a-4de6-8a6e-51f1fc037b14 req-b62df00e-575e-44a1-8972-68ce78bdca06 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1174386 Nov 08 16:11:57.749209 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3e7ad14a-6975-4075-ac69-3a504ad24341 {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:11:57.758838 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 70c72d16-a0e9-49bb-b7b8-ef436d81a390, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=70c72d16-a0e9-49bb-b7b8-ef436d81a390,segment=NetworkSegment(297c0462-3903-48e7-a4ef-95b52eec7b18),segment_id=297c0462-3903-48e7-a4ef-95b52eec7b18)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:11:57.777370 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:57.778223 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 4020a644-ef2e-4dd8-931a-cfccef4e7b15 up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:11:57.788399 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-537c8e29-ee88-4c29-ad5d-b6cebe7cc37c req-2bbcd313-0e87-47c5-83f2-853012c5d930 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1065779 Nov 08 16:11:57.850536 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 3e7ad14a-6975-4075-ac69-3a504ad24341, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=3e7ad14a-6975-4075-ac69-3a504ad24341,segment=NetworkSegment(e14404ea-b710-490a-b578-a605dfc73350),segment_id=e14404ea-b710-490a-b578-a605dfc73350)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:11:57.874953 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=70c72d16-a0e9-49bb-b7b8-ef436d81a390,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:57.890590 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-585e8c8c-4f26-4625-b68a-f757477b9b9e" -d '{"events": [{"server_uuid": "ec4f96b9-4128-4da6-9880-95a0f72fd4e2", "name": "network-vif-plugged", "status": "completed", "tag": "70c72d16-a0e9-49bb-b7b8-ef436d81a390"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:11:57.891467 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbd85f61-2680-48d0-8a37-17ce2b10719f req-198d181a-2aab-44fb-8c81-23ef1cb776c2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:57.897047 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:57.901900 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dbd85f61-2680-48d0-8a37-17ce2b10719f req-198d181a-2aab-44fb-8c81-23ef1cb776c2 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 946 time: 0.0877087 Nov 08 16:11:57.966708 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning for port 4020a644-ef2e-4dd8-931a-cfccef4e7b15 completed by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 16:11:57.977697 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port 4020a644-ef2e-4dd8-931a-cfccef4e7b15 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:11:57.977697 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:58.007911 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=3e7ad14a-6975-4075-ac69-3a504ad24341,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:58.009761 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dbd85f61-2680-48d0-8a37-17ce2b10719f req-d1eb4c8a-4b6d-473f-aa78-106a478da436 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1061327 Nov 08 16:11:58.071750 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:11:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-86032056-45c7-4952-82b1-9e66ae15b252 x-openstack-request-id: req-86032056-45c7-4952-82b1-9e66ae15b252 {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:11:58.072062 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ec4f96b9-4128-4da6-9880-95a0f72fd4e2", "name": "network-vif-plugged", "status": "completed", "tag": "70c72d16-a0e9-49bb-b7b8-ef436d81a390", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:11:58.072315 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-86032056-45c7-4952-82b1-9e66ae15b252 {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:11:58.072879 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ec4f96b9-4128-4da6-9880-95a0f72fd4e2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '70c72d16-a0e9-49bb-b7b8-ef436d81a390', 'code': 200} Nov 08 16:11:58.089214 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:58.124210 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 4020a644-ef2e-4dd8-931a-cfccef4e7b15, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=4020a644-ef2e-4dd8-931a-cfccef4e7b15,segment=NetworkSegment(fab7ad78-c438-48e7-8fdb-80ff50b8600c),segment_id=fab7ad78-c438-48e7-8fdb-80ff50b8600c)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:11:58.127596 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:58.176673 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=4020a644-ef2e-4dd8-931a-cfccef4e7b15,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:58.274614 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-768346ab-5cdf-4ab5-88a0-a901e6fbf236 req-03985088-5513-4f7f-8965-85aaeec46efb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:58.276118 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-768346ab-5cdf-4ab5-88a0-a901e6fbf236 req-03985088-5513-4f7f-8965-85aaeec46efb service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 1099 time: 0.0696929 Nov 08 16:11:58.296047 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-768346ab-5cdf-4ab5-88a0-a901e6fbf236 req-f5af8253-3840-4ed4-9933-ee2d18317414 service neutron] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:58.366301 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-768346ab-5cdf-4ab5-88a0-a901e6fbf236 req-f5af8253-3840-4ed4-9933-ee2d18317414 service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:58.370226 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-768346ab-5cdf-4ab5-88a0-a901e6fbf236 req-f5af8253-3840-4ed4-9933-ee2d18317414 service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:11:58.414497 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-768346ab-5cdf-4ab5-88a0-a901e6fbf236 req-f5af8253-3840-4ed4-9933-ee2d18317414 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1303775 Nov 08 16:11:58.415432 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5af8253-3840-4ed4-9933-ee2d18317414 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=247822ed-038e-43c0-8490-31f4c80e1177,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:11:58.525670 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9239b830-5f63-46b5-8231-4449f662361c req-53e1205a-8ebe-4f3f-8a95-863291949124 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:58.527207 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9239b830-5f63-46b5-8231-4449f662361c req-53e1205a-8ebe-4f3f-8a95-863291949124 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 945 time: 0.0497751 Nov 08 16:11:58.530531 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['3e7ad14a-6975-4075-ac69-3a504ad24341'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:11:58.607312 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ebc44b-913c-4381-bd06-54d72ad8ed82 req-44511a92-ef07-4b53-b743-3a5aabe7bffa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:58.608808 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-12ebc44b-913c-4381-bd06-54d72ad8ed82 req-44511a92-ef07-4b53-b743-3a5aabe7bffa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 944 time: 0.0806601 Nov 08 16:11:58.611994 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9239b830-5f63-46b5-8231-4449f662361c req-2305bac4-2623-43b8-81ea-eca0f6d55ee9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0739884 Nov 08 16:11:58.658953 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-12ebc44b-913c-4381-bd06-54d72ad8ed82 req-be213e79-9801-424b-be30-60c7badbf8fb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437741 Nov 08 16:11:58.847814 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01589e6a-2e26-4cf7-9669-0b2a5667704d req-2f4d9ca2-786f-46ec-b14f-d87b4e9d93d5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:58.850392 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-01589e6a-2e26-4cf7-9669-0b2a5667704d req-2f4d9ca2-786f-46ec-b14f-d87b4e9d93d5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 943 time: 0.0540559 Nov 08 16:11:58.931705 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40f59108-39a2-4f73-a724-5949d9194189 req-b2beda2f-b803-471f-9549-3de7a6d7acd4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:58.933224 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-40f59108-39a2-4f73-a724-5949d9194189 req-b2beda2f-b803-471f-9549-3de7a6d7acd4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 945 time: 0.0811129 Nov 08 16:11:58.936910 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-01589e6a-2e26-4cf7-9669-0b2a5667704d req-f5dedbae-fed6-4036-a3be-524470f41eb3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0759399 Nov 08 16:11:58.998092 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-40f59108-39a2-4f73-a724-5949d9194189 req-43fad70f-d53f-4db2-8b6d-f010b4557366 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0580342 Nov 08 16:11:59.129095 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b97f01d4-5f58-47fa-87e4-9522dcc5998f req-90563d2e-7144-4ad7-8ccf-97418bff248a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:59.131057 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b97f01d4-5f58-47fa-87e4-9522dcc5998f req-90563d2e-7144-4ad7-8ccf-97418bff248a tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 946 time: 0.0503681 Nov 08 16:11:59.176188 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b97f01d4-5f58-47fa-87e4-9522dcc5998f req-e7cfdc60-380c-42de-a765-b5e5893abd99 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393884 Nov 08 16:11:59.729392 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6cbf53d-3353-4c27-b7b3-06718df30998 req-b5b64210-9a93-407a-811b-1c50b273f0ef tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:59.730965 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b6cbf53d-3353-4c27-b7b3-06718df30998 req-b5b64210-9a93-407a-811b-1c50b273f0ef tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 945 time: 0.0517468 Nov 08 16:11:59.803392 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-505cfbfd-3afb-4361-b552-b6323afb68d9 req-25e884fa-6b28-4de0-9920-d10631133208 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:11:59.804865 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-505cfbfd-3afb-4361-b552-b6323afb68d9 req-25e884fa-6b28-4de0-9920-d10631133208 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 944 time: 0.0726004 Nov 08 16:11:59.812598 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b6cbf53d-3353-4c27-b7b3-06718df30998 req-da57a3b5-3c02-4cff-a0e2-80c6758282ef tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0715556 Nov 08 16:11:59.855087 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-505cfbfd-3afb-4361-b552-b6323afb68d9 req-88ab96ae-457a-4c21-ae2b-7bbc104e25c2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414147 Nov 08 16:12:00.059211 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29a3ff27-6ca3-427b-bd7c-575c65f3cf54 req-a0a5219e-9e7b-41dd-bc69-451ff65425b2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:00.060775 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-29a3ff27-6ca3-427b-bd7c-575c65f3cf54 req-a0a5219e-9e7b-41dd-bc69-451ff65425b2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 943 time: 0.0520203 Nov 08 16:12:00.073919 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dfa35d29-db7d-4fab-a001-7db0d508d70a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4020a644-ef2e-4dd8-931a-cfccef4e7b15'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:12:00.076285 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4f5fba37-2de8-4220-809e-792b9ae4ce2a" -d '{"events": [{"server_uuid": "dfa35d29-db7d-4fab-a001-7db0d508d70a", "name": "network-vif-plugged", "status": "completed", "tag": "4020a644-ef2e-4dd8-931a-cfccef4e7b15"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:12:00.141753 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-29a3ff27-6ca3-427b-bd7c-575c65f3cf54 req-57bb9605-b7c5-4251-a4bf-0f7ad10bd3bb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0748415 Nov 08 16:12:00.150711 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4114a1f-1758-4677-b0b2-e95a80b7c3c5 req-7dfcc404-9480-453a-923b-2828ef1ab8ba tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:00.152248 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b4114a1f-1758-4677-b0b2-e95a80b7c3c5 req-7dfcc404-9480-453a-923b-2828ef1ab8ba tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 945 time: 0.0836120 Nov 08 16:12:00.185566 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:12:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3e8e39ba-8627-42d7-839a-2d596f6b3fda x-openstack-request-id: req-3e8e39ba-8627-42d7-839a-2d596f6b3fda {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:12:00.185912 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dfa35d29-db7d-4fab-a001-7db0d508d70a", "name": "network-vif-plugged", "status": "completed", "tag": "4020a644-ef2e-4dd8-931a-cfccef4e7b15", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:12:00.186164 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-3e8e39ba-8627-42d7-839a-2d596f6b3fda {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:12:00.186556 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dfa35d29-db7d-4fab-a001-7db0d508d70a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4020a644-ef2e-4dd8-931a-cfccef4e7b15', 'code': 200} Nov 08 16:12:00.205425 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b4114a1f-1758-4677-b0b2-e95a80b7c3c5 req-fb4e470a-c920-4fb3-9e69-24c2c1572866 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426290 Nov 08 16:12:00.288893 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84677985-3e60-4932-aeff-13916a574f33 req-37c17c43-789a-4b8a-9a4e-8a5964e2b196 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:00.290400 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-84677985-3e60-4932-aeff-13916a574f33 req-37c17c43-789a-4b8a-9a4e-8a5964e2b196 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 946 time: 0.0477235 Nov 08 16:12:00.335211 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-84677985-3e60-4932-aeff-13916a574f33 req-9a221b13-932d-4248-9c7b-b53c56baaa96 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390170 Nov 08 16:12:00.902613 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device f4784d76-6af7-4b31-a9f3-ee25c9087b51 details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:12:00.907311 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device fbefda08-fc7a-42a0-b714-6dea3d8a5161 up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:12:00.928991 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85eebf51-4650-4bfe-9021-ee0ac8efcdf2 req-f82bf028-d3df-4737-aa29-d5c5c20ee13c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:00.930542 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-85eebf51-4650-4bfe-9021-ee0ac8efcdf2 req-f82bf028-d3df-4737-aa29-d5c5c20ee13c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 945 time: 0.0532479 Nov 08 16:12:01.008812 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-85eebf51-4650-4bfe-9021-ee0ac8efcdf2 req-1e12c7d2-4ff7-4d06-bfaf-68163f3de2ab tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0717862 Nov 08 16:12:01.017297 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b490180-ac44-485a-9cf0-99a4feac405c req-0390d495-d007-4f45-8e33-a60862f5bdac tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:01.018821 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2b490180-ac44-485a-9cf0-99a4feac405c req-0390d495-d007-4f45-8e33-a60862f5bdac tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 944 time: 0.0743303 Nov 08 16:12:01.023268 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning for port fbefda08-fc7a-42a0-b714-6dea3d8a5161 completed by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 16:12:01.036851 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port fbefda08-fc7a-42a0-b714-6dea3d8a5161 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:01.037378 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:01.071835 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2b490180-ac44-485a-9cf0-99a4feac405c req-ca3379fd-b611-4e72-9827-c8a4894e1065 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457146 Nov 08 16:12:01.074388 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port f4784d76-6af7-4b31-a9f3-ee25c9087b51, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=f4784d76-6af7-4b31-a9f3-ee25c9087b51,segment=NetworkSegment(7651dfae-d245-4d32-b379-dc243d043404),segment_id=7651dfae-d245-4d32-b379-dc243d043404)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:12:01.093912 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': 'f4784d76-6af7-4b31-a9f3-ee25c9087b51', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'port_id': 'f4784d76-6af7-4b31-a9f3-ee25c9087b51', 'mac_address': 'fa:16:3e:55:1f:60', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 191, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:12:01.156702 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:01.173123 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:01.183327 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f4784d76-6af7-4b31-a9f3-ee25c9087b51 {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:12:01.218243 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port f4784d76-6af7-4b31-a9f3-ee25c9087b51, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=f4784d76-6af7-4b31-a9f3-ee25c9087b51,segment=NetworkSegment(7651dfae-d245-4d32-b379-dc243d043404),segment_id=7651dfae-d245-4d32-b379-dc243d043404)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:12:01.228216 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:01.231827 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port fbefda08-fc7a-42a0-b714-6dea3d8a5161, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=fbefda08-fc7a-42a0-b714-6dea3d8a5161,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:12:01.236383 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:01.260915 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-072ab560-73f3-42f5-bf0d-0a295fbb8e23 req-a9ad1db0-22b5-4d13-9e0b-7c670a1a8571 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:01.262593 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-072ab560-73f3-42f5-bf0d-0a295fbb8e23 req-a9ad1db0-22b5-4d13-9e0b-7c670a1a8571 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 944 time: 0.0495241 Nov 08 16:12:01.280817 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=f4784d76-6af7-4b31-a9f3-ee25c9087b51,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:01.328537 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=fbefda08-fc7a-42a0-b714-6dea3d8a5161,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:01.341628 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-072ab560-73f3-42f5-bf0d-0a295fbb8e23 req-1f3f270e-232c-46df-8091-3e7a77b02fd2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0731606 Nov 08 16:12:01.354701 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44797852-3042-4988-8ad3-251610b35f7d req-03c56d41-790e-4165-aeaf-468f51c60439 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:01.357423 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-44797852-3042-4988-8ad3-251610b35f7d req-03c56d41-790e-4165-aeaf-468f51c60439 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 945 time: 0.0718997 Nov 08 16:12:01.406055 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-44797852-3042-4988-8ad3-251610b35f7d req-1c43c08a-5764-42a2-9a1a-6ac97dd9c9b9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440876 Nov 08 16:12:01.456864 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c6f219c-94d7-4fd7-9f8a-8ebbd10fadde req-f4f4a2f2-d922-4cf9-a63e-bc961c7f020d tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:01.458356 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1c6f219c-94d7-4fd7-9f8a-8ebbd10fadde req-f4f4a2f2-d922-4cf9-a63e-bc961c7f020d tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 946 time: 0.0569558 Nov 08 16:12:01.505174 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1c6f219c-94d7-4fd7-9f8a-8ebbd10fadde req-5c061c15-bb93-4a10-b74d-163e4c1e72c5 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407698 Nov 08 16:12:02.127265 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45d1584d-dd41-4516-8b94-62c5c5e8f904 req-1fceff7a-ec36-4f17-a67d-66c471c0c295 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:02.130902 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-45d1584d-dd41-4516-8b94-62c5c5e8f904 req-1fceff7a-ec36-4f17-a67d-66c471c0c295 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 945 time: 0.0556676 Nov 08 16:12:02.188110 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c1c8c8d-5f78-45fb-803d-8f7a84df3433', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fbefda08-fc7a-42a0-b714-6dea3d8a5161'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:12:02.190469 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3466e708-fd2e-4272-a4d5-cf1a5a908b51" -d '{"events": [{"server_uuid": "1c1c8c8d-5f78-45fb-803d-8f7a84df3433", "name": "network-vif-plugged", "status": "completed", "tag": "fbefda08-fc7a-42a0-b714-6dea3d8a5161"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:12:02.205703 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-45d1584d-dd41-4516-8b94-62c5c5e8f904 req-80129a49-5325-4d4c-a8d1-c7cf07033dde tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0678587 Nov 08 16:12:02.218663 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f27d199-7a75-4a91-9e93-a51fff858dc9 req-6b081fdc-72df-42cd-b1c6-172a47d8d28f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:02.220168 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7f27d199-7a75-4a91-9e93-a51fff858dc9 req-6b081fdc-72df-42cd-b1c6-172a47d8d28f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0684748 Nov 08 16:12:02.259031 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:12:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6af08002-8019-49a8-a9e0-a0dd14f258ee x-openstack-request-id: req-6af08002-8019-49a8-a9e0-a0dd14f258ee {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:12:02.259031 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1c1c8c8d-5f78-45fb-803d-8f7a84df3433", "name": "network-vif-plugged", "status": "completed", "tag": "fbefda08-fc7a-42a0-b714-6dea3d8a5161", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:12:02.259031 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-6af08002-8019-49a8-a9e0-a0dd14f258ee {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:12:02.259031 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c1c8c8d-5f78-45fb-803d-8f7a84df3433', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fbefda08-fc7a-42a0-b714-6dea3d8a5161', 'code': 200} Nov 08 16:12:02.273094 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7f27d199-7a75-4a91-9e93-a51fff858dc9 req-4c1f39fa-7c96-4be6-800d-e7f84ce41bed tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461650 Nov 08 16:12:02.458220 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2650c331-0573-4834-8f5e-0f61890228ba req-5f7ca834-fbc4-4ed1-a2c3-ce224fde02e6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:02.459716 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2650c331-0573-4834-8f5e-0f61890228ba req-5f7ca834-fbc4-4ed1-a2c3-ce224fde02e6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 944 time: 0.0507591 Nov 08 16:12:02.532688 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2650c331-0573-4834-8f5e-0f61890228ba req-2e85e69c-f07e-4f74-a186-66ba790908ea tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0669463 Nov 08 16:12:02.544824 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28e597a3-8c6f-42b3-bbea-1820765ff321 req-762b0d86-fdf2-4447-926a-d6b51971a3de tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:02.546329 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-28e597a3-8c6f-42b3-bbea-1820765ff321 req-762b0d86-fdf2-4447-926a-d6b51971a3de tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 945 time: 0.0733089 Nov 08 16:12:02.602720 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-28e597a3-8c6f-42b3-bbea-1820765ff321 req-c27396f1-e0fa-4d6b-b093-016eacad541d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495439 Nov 08 16:12:02.638060 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ec19844-ede7-46f3-893b-57da29ec0ca2 req-68016899-2b5c-4ec6-897a-b7692fb574df tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:02.639502 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7ec19844-ede7-46f3-893b-57da29ec0ca2 req-68016899-2b5c-4ec6-897a-b7692fb574df tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 946 time: 0.0520072 Nov 08 16:12:02.687747 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7ec19844-ede7-46f3-893b-57da29ec0ca2 req-7716cf47-9e31-42fc-add9-1644477702e0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425303 Nov 08 16:12:03.316883 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f1f1bb7-5bcb-4fbf-b1a5-cb2995c7dd27 req-28493619-de8f-4cc2-a1a7-ab6359f5c430 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:03.318415 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1f1f1bb7-5bcb-4fbf-b1a5-cb2995c7dd27 req-28493619-de8f-4cc2-a1a7-ab6359f5c430 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 945 time: 0.0477705 Nov 08 16:12:03.388262 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1f1f1bb7-5bcb-4fbf-b1a5-cb2995c7dd27 req-bac0f666-ebf2-4636-ae8f-9a06f3038900 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0638947 Nov 08 16:12:03.406372 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63f1bebb-0388-4b85-834d-ec393ac55c00 req-f764c616-bf54-417e-860f-f4b1c50701c7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:03.407838 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-63f1bebb-0388-4b85-834d-ec393ac55c00 req-f764c616-bf54-417e-860f-f4b1c50701c7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0639558 Nov 08 16:12:03.458524 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-63f1bebb-0388-4b85-834d-ec393ac55c00 req-8cb3d371-1b3b-4909-9733-7eb22cc3a94a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441813 Nov 08 16:12:03.617137 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 17db566c-bf28-4091-b7f6-4ffa5f80c982 details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:12:03.660817 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37176392-8aba-4a82-ba1b-2aea8990740b req-63b1abe5-9354-4329-b094-77e1697d66b8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:03.662469 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-37176392-8aba-4a82-ba1b-2aea8990740b req-63b1abe5-9354-4329-b094-77e1697d66b8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 944 time: 0.0656517 Nov 08 16:12:03.736788 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 17db566c-bf28-4091-b7f6-4ffa5f80c982, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=17db566c-bf28-4091-b7f6-4ffa5f80c982,segment=NetworkSegment(e14404ea-b710-490a-b578-a605dfc73350),segment_id=e14404ea-b710-490a-b578-a605dfc73350)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:12:03.749509 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': '17db566c-bf28-4091-b7f6-4ffa5f80c982', 'network_id': '2d5b5768-37f3-49a1-b451-2803f6f97429', 'port_id': '17db566c-bf28-4091-b7f6-4ffa5f80c982', 'mac_address': 'fa:16:3e:fb:3b:fa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 164, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6936707c-bd3f-4cd8-9462-a4af0ea16ed8', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:12:03.762740 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-37176392-8aba-4a82-ba1b-2aea8990740b req-9eb6c6db-ee73-43e7-a1b3-04e3f62361a2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0942862 Nov 08 16:12:03.770184 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5653287e-5e3d-4a2f-a340-ceb3fd0c3d7a req-c2273ebf-d5eb-46cd-8c92-1d82fdc78934 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:03.772216 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5653287e-5e3d-4a2f-a340-ceb3fd0c3d7a req-c2273ebf-d5eb-46cd-8c92-1d82fdc78934 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 945 time: 0.0830100 Nov 08 16:12:03.788189 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:03.802637 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 17db566c-bf28-4091-b7f6-4ffa5f80c982 {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:12:03.823606 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 17db566c-bf28-4091-b7f6-4ffa5f80c982, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=17db566c-bf28-4091-b7f6-4ffa5f80c982,segment=NetworkSegment(e14404ea-b710-490a-b578-a605dfc73350),segment_id=e14404ea-b710-490a-b578-a605dfc73350)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:12:03.827744 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:03.834239 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5653287e-5e3d-4a2f-a340-ceb3fd0c3d7a req-239ab1c5-9ca0-4723-9387-c15d5ca0655e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0512033 Nov 08 16:12:03.879441 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=17db566c-bf28-4091-b7f6-4ffa5f80c982,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:03.887497 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:03.887908 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:03.888279 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:03.888520 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:03.889172 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:03.889172 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:03.889433 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:03.889771 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:03.890112 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:03.890469 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:03.890781 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:03.891091 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:03.913229 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76571458-3b6a-4f1e-b710-a9dcafaa5a75 req-87ded10b-fa63-4aa0-85ac-e27e523ded83 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:03.914737 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-76571458-3b6a-4f1e-b710-a9dcafaa5a75 req-87ded10b-fa63-4aa0-85ac-e27e523ded83 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 946 time: 0.0897670 Nov 08 16:12:03.920368 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bd01855-26b7-4a66-9099-d37a2502c0ff req-05a4e864-3c21-4d2c-9639-b120021a1655 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:03.921797 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9bd01855-26b7-4a66-9099-d37a2502c0ff req-05a4e864-3c21-4d2c-9639-b120021a1655 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 1098 time: 0.0784640 Nov 08 16:12:03.941413 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be3b75b9-7c1f-48da-b173-0983af7663c7 req-11113694-d943-4af8-829f-f6c9c2863f99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:03.943129 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-be3b75b9-7c1f-48da-b173-0983af7663c7 req-11113694-d943-4af8-829f-f6c9c2863f99 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 1098 time: 0.0789659 Nov 08 16:12:03.989259 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-76571458-3b6a-4f1e-b710-a9dcafaa5a75 req-809549e5-d70e-4700-bc51-0acfe803a814 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0665219 Nov 08 16:12:03.992553 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9bd01855-26b7-4a66-9099-d37a2502c0ff req-1c927996-8f9e-414c-8225-fb8f86ade993 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0628505 Nov 08 16:12:03.992791 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-be3b75b9-7c1f-48da-b173-0983af7663c7 req-78e0445b-b30e-4e59-b70b-7b6300bd2ac4 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426810 Nov 08 16:12:04.500640 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cac1e22-31b8-4332-a3a4-3adc97984131 req-53f6bb75-e64a-48c3-b230-6b50e5fcfd74 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:04.502157 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1cac1e22-31b8-4332-a3a4-3adc97984131 req-53f6bb75-e64a-48c3-b230-6b50e5fcfd74 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 945 time: 0.0490870 Nov 08 16:12:04.577443 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1cac1e22-31b8-4332-a3a4-3adc97984131 req-7a76d4f5-34d8-45b4-ab68-739cf9921dcb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0691576 Nov 08 16:12:04.593058 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f389e7a2-4c1c-4be8-aef2-7198032fd680 req-bb43732a-b72e-4faa-8480-bd38b97c6231 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:04.594528 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f389e7a2-4c1c-4be8-aef2-7198032fd680 req-bb43732a-b72e-4faa-8480-bd38b97c6231 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0651400 Nov 08 16:12:04.639667 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f389e7a2-4c1c-4be8-aef2-7198032fd680 req-b0c0b612-eefd-43ff-8836-bf9255c36cc5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391848 Nov 08 16:12:04.842620 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['f4784d76-6af7-4b31-a9f3-ee25c9087b51'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:12:04.875497 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-629fbc85-18a3-49b8-8063-c8793522e980 req-69e04665-77a5-4724-a8ed-48f2f13c94c7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:04.876972 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-629fbc85-18a3-49b8-8063-c8793522e980 req-69e04665-77a5-4724-a8ed-48f2f13c94c7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 944 time: 0.0481672 Nov 08 16:12:04.951358 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-629fbc85-18a3-49b8-8063-c8793522e980 req-8553bc66-ac3a-4d56-91e8-348d4360b609 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0684755 Nov 08 16:12:04.964759 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84c34d32-d278-4d56-aada-bfb3cdd4d602 req-d66c877d-eb4b-48a6-868f-a31732b12e0d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:04.966248 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-84c34d32-d278-4d56-aada-bfb3cdd4d602 req-d66c877d-eb4b-48a6-868f-a31732b12e0d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 945 time: 0.0676777 Nov 08 16:12:05.016352 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-84c34d32-d278-4d56-aada-bfb3cdd4d602 req-7ebe1f4e-e9bf-46d6-ac80-5b33a0d74f14 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439534 Nov 08 16:12:05.099697 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47060996-31b6-41aa-9fd3-b82aab9ce2e0 req-78d667af-35cf-4137-8d8a-451687172242 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:05.101149 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-47060996-31b6-41aa-9fd3-b82aab9ce2e0 req-78d667af-35cf-4137-8d8a-451687172242 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 946 time: 0.0469282 Nov 08 16:12:05.147667 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-47060996-31b6-41aa-9fd3-b82aab9ce2e0 req-d0d44855-5246-4bb8-8646-975c91c95cef tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407162 Nov 08 16:12:05.344063 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['17db566c-bf28-4091-b7f6-4ffa5f80c982'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:12:05.649828 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 3e7ad14a-6975-4075-ac69-3a504ad24341 up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:12:05.691271 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97e7b27b-41c8-4d08-9d97-2c1637ef8253 req-1fef7e38-4a30-4207-b53a-6086b2fe2aa6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:05.693275 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-97e7b27b-41c8-4d08-9d97-2c1637ef8253 req-1fef7e38-4a30-4207-b53a-6086b2fe2aa6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 945 time: 0.0499740 Nov 08 16:12:05.700851 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning for port 3e7ad14a-6975-4075-ac69-3a504ad24341 completed by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 16:12:05.710891 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port 3e7ad14a-6975-4075-ac69-3a504ad24341 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:05.711257 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:05.774683 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-97e7b27b-41c8-4d08-9d97-2c1637ef8253 req-ad1f475c-fe2d-441e-b552-ef01b64a879c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0740273 Nov 08 16:12:05.789145 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-275a5197-cab0-4877-a82c-a853545294a2 req-04f3784c-9579-4490-9f0f-6cc3526267fb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:05.789145 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-275a5197-cab0-4877-a82c-a853545294a2 req-04f3784c-9579-4490-9f0f-6cc3526267fb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0704122 Nov 08 16:12:05.791082 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:05.814383 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a3a953f3-d586-4495-b2d1-3c6e6cd89a52', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3e7ad14a-6975-4075-ac69-3a504ad24341'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:12:05.816961 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9a5bc1b2-83fc-4801-901f-d8e7b1a84b6f" -d '{"events": [{"server_uuid": "a3a953f3-d586-4495-b2d1-3c6e6cd89a52", "name": "network-vif-plugged", "status": "completed", "tag": "3e7ad14a-6975-4075-ac69-3a504ad24341"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:12:05.829885 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 3e7ad14a-6975-4075-ac69-3a504ad24341, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=3e7ad14a-6975-4075-ac69-3a504ad24341,segment=NetworkSegment(e14404ea-b710-490a-b578-a605dfc73350),segment_id=e14404ea-b710-490a-b578-a605dfc73350)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:12:05.835120 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:05.838809 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-275a5197-cab0-4877-a82c-a853545294a2 req-a9e0ba3e-79c5-4837-aab8-b97ad1e050d0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427103 Nov 08 16:12:05.858388 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:12:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-45d195a3-c89f-4804-b6f5-9d09fc9df6bb x-openstack-request-id: req-45d195a3-c89f-4804-b6f5-9d09fc9df6bb {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:12:05.858889 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a3a953f3-d586-4495-b2d1-3c6e6cd89a52", "name": "network-vif-plugged", "status": "completed", "tag": "3e7ad14a-6975-4075-ac69-3a504ad24341", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:12:05.858991 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-45d195a3-c89f-4804-b6f5-9d09fc9df6bb {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:12:05.859303 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a3a953f3-d586-4495-b2d1-3c6e6cd89a52', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3e7ad14a-6975-4075-ac69-3a504ad24341', 'code': 200} Nov 08 16:12:05.884705 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=3e7ad14a-6975-4075-ac69-3a504ad24341,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:06.018018 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24df92a3-1643-48da-a160-94f6fc9bc51b req-f07488aa-3b55-4c4b-b09e-804a5cc8b82f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:06.019838 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-24df92a3-1643-48da-a160-94f6fc9bc51b req-f07488aa-3b55-4c4b-b09e-804a5cc8b82f service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 1099 time: 0.0405083 Nov 08 16:12:06.064997 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-24df92a3-1643-48da-a160-94f6fc9bc51b req-372a974e-171c-4010-a3bc-344e0a191bc8 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0373731 Nov 08 16:12:06.068888 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24ff2389-eba7-42ed-bbfc-ed46c22c8cfd req-b7d4cf04-fbd8-4b46-a1e7-33336efe8bc5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:06.070420 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-24ff2389-eba7-42ed-bbfc-ed46c22c8cfd req-b7d4cf04-fbd8-4b46-a1e7-33336efe8bc5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 944 time: 0.0508130 Nov 08 16:12:06.148239 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-24ff2389-eba7-42ed-bbfc-ed46c22c8cfd req-927c2193-d5b3-4f18-85a2-4417e46e35e5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0716276 Nov 08 16:12:06.160985 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b887212-227f-47e7-8e32-2825fa6b7843 req-7a7de137-4055-432b-b04d-73ae72267bea tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:06.163074 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4b887212-227f-47e7-8e32-2825fa6b7843 req-7a7de137-4055-432b-b04d-73ae72267bea tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 945 time: 0.0728545 Nov 08 16:12:06.211743 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4b887212-227f-47e7-8e32-2825fa6b7843 req-e717369d-78db-44cc-9d6b-c09844f36888 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425863 Nov 08 16:12:06.261101 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66461086-14bf-48a4-b428-89382dc6d718 req-ff210830-441d-441c-81e8-c52c9ea6ed70 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:06.262623 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-66461086-14bf-48a4-b428-89382dc6d718 req-ff210830-441d-441c-81e8-c52c9ea6ed70 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 946 time: 0.0469320 Nov 08 16:12:06.308698 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-66461086-14bf-48a4-b428-89382dc6d718 req-d2508d1e-a854-46c7-94b8-f5836cfd91ed tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402877 Nov 08 16:12:06.886713 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-118b4357-877f-4f59-969b-75efafe76fe0 req-d6718350-f527-4bf8-b4ce-c692127ca2eb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:06.888168 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-118b4357-877f-4f59-969b-75efafe76fe0 req-d6718350-f527-4bf8-b4ce-c692127ca2eb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0471275 Nov 08 16:12:06.961810 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-118b4357-877f-4f59-969b-75efafe76fe0 req-bfb33318-7b90-44c1-8ce9-ae84f2c38abe tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0670385 Nov 08 16:12:06.978907 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c97ffe91-bd59-4e04-aa1c-bab88fa364b2 req-ac3e13ec-a53a-49fb-97ce-a23c182039fd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:06.980320 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c97ffe91-bd59-4e04-aa1c-bab88fa364b2 req-ac3e13ec-a53a-49fb-97ce-a23c182039fd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0660369 Nov 08 16:12:07.025779 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c97ffe91-bd59-4e04-aa1c-bab88fa364b2 req-a835c107-30d5-41d3-8398-88b0b38207c8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395629 Nov 08 16:12:07.259939 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f090ddff-1569-4dee-9a3d-54fa24eeb6d9 req-0317767a-4ffc-40dd-b73f-c3851a2b6a36 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:07.261410 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f090ddff-1569-4dee-9a3d-54fa24eeb6d9 req-0317767a-4ffc-40dd-b73f-c3851a2b6a36 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 944 time: 0.0471182 Nov 08 16:12:07.340868 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f090ddff-1569-4dee-9a3d-54fa24eeb6d9 req-bdff8c5a-a8c9-4c1f-a368-16c9fd62a6b2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0730686 Nov 08 16:12:07.353440 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eb3e53e-421f-45bf-a75a-c60e30818e9c req-415adcff-d9c2-4a81-8224-6be7cd438ae1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:07.354917 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2eb3e53e-421f-45bf-a75a-c60e30818e9c req-415adcff-d9c2-4a81-8224-6be7cd438ae1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 945 time: 0.0747137 Nov 08 16:12:07.410402 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2eb3e53e-421f-45bf-a75a-c60e30818e9c req-d24dad36-d663-437c-bd58-d3dde119c13d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494161 Nov 08 16:12:07.445109 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45de91a7-d4de-4435-b77c-dcf75bc9cda5 req-b410ae83-4c38-494e-a1a4-df3b2b41ca32 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:07.446583 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-45de91a7-d4de-4435-b77c-dcf75bc9cda5 req-b410ae83-4c38-494e-a1a4-df3b2b41ca32 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 946 time: 0.0488272 Nov 08 16:12:07.491736 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-45de91a7-d4de-4435-b77c-dcf75bc9cda5 req-433ea388-cd0c-411a-a8ae-4a37e58174c0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392773 Nov 08 16:12:08.072204 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01939058-97e2-4271-9cb5-5d2f0b159aca req-3b98c6e3-9762-40a2-a8b5-0f34efc507bf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:08.073754 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-01939058-97e2-4271-9cb5-5d2f0b159aca req-3b98c6e3-9762-40a2-a8b5-0f34efc507bf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0474355 Nov 08 16:12:08.099963 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ead5586e-3fef-4a55-b8c1-7ddc0cdd6d2a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:08.151069 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-01939058-97e2-4271-9cb5-5d2f0b159aca req-2d3fef3a-f75a-4488-bb9d-512baadd258c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0715590 Nov 08 16:12:08.165646 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbda86de-b6a9-4c0e-a917-1896ffe2a38a req-7c1dd957-9c52-4f0a-a5a8-76a1614f113c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:08.167123 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cbda86de-b6a9-4c0e-a917-1896ffe2a38a req-7c1dd957-9c52-4f0a-a5a8-76a1614f113c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0658376 Nov 08 16:12:08.213895 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cbda86de-b6a9-4c0e-a917-1896ffe2a38a req-0d204c88-2ac1-442a-a5f7-3572a03dea47 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410075 Nov 08 16:12:08.451080 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-035dffa7-5ec0-495a-a731-0dea626c4ac1 req-7b290700-8000-4c23-86e3-14214e3c5064 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:08.452580 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-035dffa7-5ec0-495a-a731-0dea626c4ac1 req-7b290700-8000-4c23-86e3-14214e3c5064 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 944 time: 0.0470374 Nov 08 16:12:08.526017 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-035dffa7-5ec0-495a-a731-0dea626c4ac1 req-64966ff3-0e48-4602-9cac-8f428813b625 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0676455 Nov 08 16:12:08.541289 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e166c6f5-4756-4d3a-99d6-5443eed79987 req-a0010626-bcb5-49a6-b583-e15c1061024a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:08.543257 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e166c6f5-4756-4d3a-99d6-5443eed79987 req-a0010626-bcb5-49a6-b583-e15c1061024a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 945 time: 0.0684128 Nov 08 16:12:08.612706 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e166c6f5-4756-4d3a-99d6-5443eed79987 req-23b08075-9d9d-430b-af71-4a7e4432d754 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0631733 Nov 08 16:12:08.633496 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fa9f5ba-18b7-4d8a-a693-faa0d412e8d2 req-823cdf34-d7f2-40fd-a5b2-41434c752995 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:08.634964 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1fa9f5ba-18b7-4d8a-a693-faa0d412e8d2 req-823cdf34-d7f2-40fd-a5b2-41434c752995 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 946 time: 0.0566077 Nov 08 16:12:08.679988 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1fa9f5ba-18b7-4d8a-a693-faa0d412e8d2 req-0b47bbbf-1c80-43ba-82d3-5da5150a940f tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392671 Nov 08 16:12:08.810415 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device f4784d76-6af7-4b31-a9f3-ee25c9087b51 up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:12:08.874617 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning for port f4784d76-6af7-4b31-a9f3-ee25c9087b51 completed by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 16:12:08.878167 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port f4784d76-6af7-4b31-a9f3-ee25c9087b51 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:08.878531 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:08.951949 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:08.973492 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b76ed94d-63f4-4597-be02-f3fc032b85aa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f4784d76-6af7-4b31-a9f3-ee25c9087b51'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:12:08.975733 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d216d2ad-ea42-4852-97e5-0811217758f2" -d '{"events": [{"server_uuid": "b76ed94d-63f4-4597-be02-f3fc032b85aa", "name": "network-vif-plugged", "status": "completed", "tag": "f4784d76-6af7-4b31-a9f3-ee25c9087b51"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:12:08.987819 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port f4784d76-6af7-4b31-a9f3-ee25c9087b51, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=f4784d76-6af7-4b31-a9f3-ee25c9087b51,segment=NetworkSegment(7651dfae-d245-4d32-b379-dc243d043404),segment_id=7651dfae-d245-4d32-b379-dc243d043404)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:12:08.993140 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:08.994023 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 17db566c-bf28-4091-b7f6-4ffa5f80c982 up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:12:09.019370 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:12:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ddd17f56-94f2-4119-9d76-46a509a480dc x-openstack-request-id: req-ddd17f56-94f2-4119-9d76-46a509a480dc {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:12:09.019678 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b76ed94d-63f4-4597-be02-f3fc032b85aa", "name": "network-vif-plugged", "status": "completed", "tag": "f4784d76-6af7-4b31-a9f3-ee25c9087b51", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:12:09.019933 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-ddd17f56-94f2-4119-9d76-46a509a480dc {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:12:09.020313 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b76ed94d-63f4-4597-be02-f3fc032b85aa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f4784d76-6af7-4b31-a9f3-ee25c9087b51', 'code': 200} Nov 08 16:12:09.175527 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=f4784d76-6af7-4b31-a9f3-ee25c9087b51,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:09.189204 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning for port 17db566c-bf28-4091-b7f6-4ffa5f80c982 completed by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 16:12:09.193385 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port 17db566c-bf28-4091-b7f6-4ffa5f80c982 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:09.193782 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:09.269058 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eb75afd-a95c-47a7-ac4f-9c0bc68bd5b2 req-418839e2-48e8-49c2-8ff4-fc907adcc600 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:09.269890 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:09.274301 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0eb75afd-a95c-47a7-ac4f-9c0bc68bd5b2 req-418839e2-48e8-49c2-8ff4-fc907adcc600 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0555687 Nov 08 16:12:09.301202 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 17db566c-bf28-4091-b7f6-4ffa5f80c982, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=17db566c-bf28-4091-b7f6-4ffa5f80c982,segment=NetworkSegment(e14404ea-b710-490a-b578-a605dfc73350),segment_id=e14404ea-b710-490a-b578-a605dfc73350)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:12:09.305654 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:09.348543 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0eb75afd-a95c-47a7-ac4f-9c0bc68bd5b2 req-574ca5ce-8da6-4390-9518-dd4135170d89 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0707691 Nov 08 16:12:09.353685 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=17db566c-bf28-4091-b7f6-4ffa5f80c982,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:09.356779 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cd33a0c-b589-4001-84b0-5e3505bb85b4 req-25244890-f976-4f9c-ad89-ff3380d75797 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:09.358264 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3cd33a0c-b589-4001-84b0-5e3505bb85b4 req-25244890-f976-4f9c-ad89-ff3380d75797 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0675614 Nov 08 16:12:09.405695 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3cd33a0c-b589-4001-84b0-5e3505bb85b4 req-d138738a-55b0-4fe6-a681-8fcbf69c9443 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411129 Nov 08 16:12:09.635401 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94859b7c-207e-44fd-af72-4d8d33e92f0b req-1ebc8954-9c63-4d9a-8849-dadf3bf557fa tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:09.636987 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-94859b7c-207e-44fd-af72-4d8d33e92f0b req-1ebc8954-9c63-4d9a-8849-dadf3bf557fa tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0469453 Nov 08 16:12:09.695646 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-94859b7c-207e-44fd-af72-4d8d33e92f0b req-d3cff073-bb17-49b2-93f9-0a04928e1b1e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0525148 Nov 08 16:12:09.731146 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94298b9f-182a-4a3b-ae8a-cdced294d9d4 req-864db9bc-958c-4509-ad55-406eeaeb99e4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:09.732771 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-94298b9f-182a-4a3b-ae8a-cdced294d9d4 req-864db9bc-958c-4509-ad55-406eeaeb99e4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 945 time: 0.0521569 Nov 08 16:12:09.807320 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-94298b9f-182a-4a3b-ae8a-cdced294d9d4 req-a4e02a50-7698-439e-94a4-0ce68a71c70b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0686274 Nov 08 16:12:09.819798 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6febb94e-69f0-4cc6-843c-2405c83a73dd req-7778bb66-400a-4add-9588-5bfce16dcc0e tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:09.821385 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6febb94e-69f0-4cc6-843c-2405c83a73dd req-7778bb66-400a-4add-9588-5bfce16dcc0e tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 946 time: 0.0691009 Nov 08 16:12:09.868352 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6febb94e-69f0-4cc6-843c-2405c83a73dd req-544a449f-b2f4-4249-8f79-c375d94879ee tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413592 Nov 08 16:12:10.470917 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e18896ce-7223-4b26-9adb-556794644db5 req-6ed80f12-6e30-43ea-8c3d-3a5b7140df1e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:10.472407 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e18896ce-7223-4b26-9adb-556794644db5 req-6ed80f12-6e30-43ea-8c3d-3a5b7140df1e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0505705 Nov 08 16:12:10.548328 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ace43867-4554-49f6-a575-1586f71c15c3 req-2f4b9e5b-d534-4cf7-acb1-a57f73b20f0e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:10.549811 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ace43867-4554-49f6-a575-1586f71c15c3 req-2f4b9e5b-d534-4cf7-acb1-a57f73b20f0e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0744202 Nov 08 16:12:10.553822 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e18896ce-7223-4b26-9adb-556794644db5 req-3076d56f-17ca-4e3a-a8ef-d8dfd9e50c0b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0705276 Nov 08 16:12:10.575309 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-a1548eb8-4cd1-43e1-8121-e80244c9060f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:10.597805 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ace43867-4554-49f6-a575-1586f71c15c3 req-c0523a59-8d2c-4f9f-af7f-6160a12e5978 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416198 Nov 08 16:12:10.804710 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e440c84-cf6a-42ac-8217-e4c0e84cb042 req-27e4fbf1-1f16-47eb-8661-374e9b555eee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:10.806238 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9e440c84-cf6a-42ac-8217-e4c0e84cb042 req-27e4fbf1-1f16-47eb-8661-374e9b555eee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0462861 Nov 08 16:12:10.867241 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9e440c84-cf6a-42ac-8217-e4c0e84cb042 req-d56037dd-8f7f-4f73-a06b-4abe0ef65f32 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0549836 Nov 08 16:12:10.921107 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ff6f7a3-9075-40bf-839d-c54533a5d36c req-2e06e0ca-be83-4503-b26c-80b359dc5ae5 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:10.922778 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5ff6f7a3-9075-40bf-839d-c54533a5d36c req-2e06e0ca-be83-4503-b26c-80b359dc5ae5 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 945 time: 0.0481398 Nov 08 16:12:10.996597 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5ff6f7a3-9075-40bf-839d-c54533a5d36c req-5c830c43-7a9c-4010-864c-75d473dce4ce tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0673835 Nov 08 16:12:11.007794 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2d12d2a-5a37-4107-8f02-089edb8da581 req-5f382160-82db-45de-a936-fd243c7014e7 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:11.009167 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d2d12d2a-5a37-4107-8f02-089edb8da581 req-5f382160-82db-45de-a936-fd243c7014e7 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 946 time: 0.0738869 Nov 08 16:12:11.021745 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '44f7e3a8-0064-42ad-9e41-03a1ba050703', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '17db566c-bf28-4091-b7f6-4ffa5f80c982'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:12:11.023999 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dfe575c4-4991-4c40-88c5-1a2db251dc17" -d '{"events": [{"server_uuid": "44f7e3a8-0064-42ad-9e41-03a1ba050703", "name": "network-vif-plugged", "status": "completed", "tag": "17db566c-bf28-4091-b7f6-4ffa5f80c982"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:12:11.055769 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d2d12d2a-5a37-4107-8f02-089edb8da581 req-1c9bc72c-7790-45e9-9cd6-faf570069609 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408478 Nov 08 16:12:11.057795 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:12:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a771dc85-00c6-435e-b8d2-9706d73632fe x-openstack-request-id: req-a771dc85-00c6-435e-b8d2-9706d73632fe {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:12:11.058110 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "44f7e3a8-0064-42ad-9e41-03a1ba050703", "name": "network-vif-plugged", "status": "completed", "tag": "17db566c-bf28-4091-b7f6-4ffa5f80c982", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:12:11.058425 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-a771dc85-00c6-435e-b8d2-9706d73632fe {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:12:11.058744 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '44f7e3a8-0064-42ad-9e41-03a1ba050703', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '17db566c-bf28-4091-b7f6-4ffa5f80c982', 'code': 200} Nov 08 16:12:11.509566 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:11.818936 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cc371bf-c8d7-40e5-bc94-dd52ae1986bd req-793a842d-2b4d-4a0b-9e5e-5df32bf091a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:11.820345 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-7cc371bf-c8d7-40e5-bc94-dd52ae1986bd req-793a842d-2b4d-4a0b-9e5e-5df32bf091a0 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 1098 time: 0.0399342 Nov 08 16:12:11.843552 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2442124b-56d8-4f9a-8da5-cbdefd32af1d req-0f4e1f0a-19d0-4e93-88e9-b6ad664c66b1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:11.844972 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2442124b-56d8-4f9a-8da5-cbdefd32af1d req-0f4e1f0a-19d0-4e93-88e9-b6ad664c66b1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.2237895 Nov 08 16:12:11.878825 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-7cc371bf-c8d7-40e5-bc94-dd52ae1986bd req-ff66fffe-474c-4ce1-8d48-646a1ea259b0 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436232 Nov 08 16:12:11.932964 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68f13aed-0653-4aeb-8bfe-3affe3151cfc req-993f3c10-223c-47f9-a633-8aa77edcb520 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:11.934423 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-68f13aed-0653-4aeb-8bfe-3affe3151cfc req-993f3c10-223c-47f9-a633-8aa77edcb520 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.1107645 Nov 08 16:12:11.942997 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d3e9e93-4ca3-42a4-8c3b-2c0b6132cf58 req-e3e7a7ed-f1ce-4a4e-8bc1-9edcd51bbc4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:11.944382 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8d3e9e93-4ca3-42a4-8c3b-2c0b6132cf58 req-e3e7a7ed-f1ce-4a4e-8bc1-9edcd51bbc4f service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 1098 time: 0.1084979 Nov 08 16:12:11.954230 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2442124b-56d8-4f9a-8da5-cbdefd32af1d req-2b50581f-ccce-4a62-9bb6-4220065d4455 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0884433 Nov 08 16:12:11.993964 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-68f13aed-0653-4aeb-8bfe-3affe3151cfc req-34dfea2e-ae24-46af-b57a-30a416549d60 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0486288 Nov 08 16:12:12.063311 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33f49044-d71f-4d73-80f9-b1ac17ada1e5 req-86a756bb-ae56-4c5b-9409-cf598ea0e319 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:12.064760 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-33f49044-d71f-4d73-80f9-b1ac17ada1e5 req-86a756bb-ae56-4c5b-9409-cf598ea0e319 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0470850 Nov 08 16:12:12.138531 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26fcb921-932c-42a7-928e-a7c3b73aa1e4 req-91a09f57-8c12-4783-87fe-f087538fa170 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:12.139984 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-26fcb921-932c-42a7-928e-a7c3b73aa1e4 req-91a09f57-8c12-4783-87fe-f087538fa170 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 945 time: 0.0743737 Nov 08 16:12:12.143199 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-33f49044-d71f-4d73-80f9-b1ac17ada1e5 req-581279aa-d6b5-4823-99c3-72760a5fda8c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0696955 Nov 08 16:12:12.187562 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-26fcb921-932c-42a7-928e-a7c3b73aa1e4 req-3bd758c7-de3f-4c6e-a8e4-94154b64aa6d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410051 Nov 08 16:12:12.272527 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6ee58ba-924b-46ed-a645-476f3f6502ff req-9ed08949-4b7c-4e17-837e-7740ac488fc8 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:12.273995 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c6ee58ba-924b-46ed-a645-476f3f6502ff req-9ed08949-4b7c-4e17-837e-7740ac488fc8 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 946 time: 0.0769029 Nov 08 16:12:12.276307 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8d3e9e93-4ca3-42a4-8c3b-2c0b6132cf58 req-38b20476-d6cd-47d8-8fd7-e9de814f2db4 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0765939 Nov 08 16:12:12.319800 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c6ee58ba-924b-46ed-a645-476f3f6502ff req-d7b9cd24-a571-487d-aa3b-866cd2353fc6 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400579 Nov 08 16:12:13.073747 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85d7acfb-1cb9-4683-819c-4d8a50d3bdc0 req-b36ade94-440e-4328-8e8d-6ad31365082f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:13.075248 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-85d7acfb-1cb9-4683-819c-4d8a50d3bdc0 req-b36ade94-440e-4328-8e8d-6ad31365082f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0537589 Nov 08 16:12:13.159472 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-115fbb36-f2a4-41dd-a745-c0f3fa1a5cdf req-2c61bc2a-7146-4d10-aea1-d8e44e1fcc88 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:13.160979 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-115fbb36-f2a4-41dd-a745-c0f3fa1a5cdf req-2c61bc2a-7146-4d10-aea1-d8e44e1fcc88 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0848536 Nov 08 16:12:13.166594 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-85d7acfb-1cb9-4683-819c-4d8a50d3bdc0 req-7f0685a1-146c-4742-9e83-e218d2e0a2b9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0808258 Nov 08 16:12:13.224436 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-115fbb36-f2a4-41dd-a745-c0f3fa1a5cdf req-8eb0d622-424e-40b6-aeb2-9ab4663b682d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0505967 Nov 08 16:12:13.240131 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:13.318645 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eccbdd9-720e-45b2-9268-c62e7334e5f7 req-4239a054-0d7a-4059-9b62-73f2ed48fff1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:13.320052 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8eccbdd9-720e-45b2-9268-c62e7334e5f7 req-4239a054-0d7a-4059-9b62-73f2ed48fff1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0546155 Nov 08 16:12:13.388303 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8aaa526-e46f-4c7a-80a4-eddba36aba2b req-96ce63b4-6def-4615-8e1b-9be46a809b62 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:13.389813 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b8aaa526-e46f-4c7a-80a4-eddba36aba2b req-96ce63b4-6def-4615-8e1b-9be46a809b62 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 945 time: 0.0869646 Nov 08 16:12:13.397212 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8eccbdd9-720e-45b2-9268-c62e7334e5f7 req-115d5fc7-4dce-47c2-8b44-39034261fe1a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0614598 Nov 08 16:12:13.442902 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b8aaa526-e46f-4c7a-80a4-eddba36aba2b req-a5d5a840-8cda-4d95-b1b6-d93b05a9f504 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447278 Nov 08 16:12:13.516228 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ea5f4fb-4b7d-49dd-b154-f2d1ec8f3066 req-0bee70c2-b01c-4fc9-8251-9bf3ccfe2b7e tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:13.517722 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2ea5f4fb-4b7d-49dd-b154-f2d1ec8f3066 req-0bee70c2-b01c-4fc9-8251-9bf3ccfe2b7e tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 946 time: 0.0501528 Nov 08 16:12:13.566159 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2ea5f4fb-4b7d-49dd-b154-f2d1ec8f3066 req-f389723e-d999-4f0d-860d-1e811e5e56b0 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416772 Nov 08 16:12:13.943024 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:14.286786 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67813cdf-a1da-4101-a40b-da1e1fb86eb8 req-28c1dd9e-db98-4bf4-9fa1-3267e2404754 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:14.288326 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-67813cdf-a1da-4101-a40b-da1e1fb86eb8 req-28c1dd9e-db98-4bf4-9fa1-3267e2404754 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0527489 Nov 08 16:12:14.368083 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-67813cdf-a1da-4101-a40b-da1e1fb86eb8 req-448d8af4-c47b-4653-8b14-91a8df5876b6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0739403 Nov 08 16:12:14.383787 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0804fa69-170d-4930-845c-f4000074109c req-0d0fff13-dba2-410a-b5ca-af13e0f23d05 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:14.385281 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0804fa69-170d-4930-845c-f4000074109c req-0d0fff13-dba2-410a-b5ca-af13e0f23d05 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0754406 Nov 08 16:12:14.433126 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0804fa69-170d-4930-845c-f4000074109c req-4e2ed6b9-27f8-44e0-838e-e22cff958148 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421555 Nov 08 16:12:14.535773 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4b061d5-111c-46f3-ba3d-78df719a167e req-d40f5e72-bb05-4388-8185-4f2ad47eda95 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:14.537359 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c4b061d5-111c-46f3-ba3d-78df719a167e req-d40f5e72-bb05-4388-8185-4f2ad47eda95 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0478511 Nov 08 16:12:14.590700 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c4b061d5-111c-46f3-ba3d-78df719a167e req-81058670-ce5c-4714-ba52-22067dbd50e8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0471094 Nov 08 16:12:14.743460 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-137fd7c4-8962-457d-ae01-38aa1ab52bee req-17f5ca33-af8f-452e-b230-a9e2e097d1e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:14.744906 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-137fd7c4-8962-457d-ae01-38aa1ab52bee req-17f5ca33-af8f-452e-b230-a9e2e097d1e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.1072352 Nov 08 16:12:14.751877 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-572c82de-0c05-4e05-acd4-7ac3138d39fd req-9da21b30-d2a7-4eaa-a46c-f094a0d6d0c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:14.751877 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-572c82de-0c05-4e05-acd4-7ac3138d39fd req-9da21b30-d2a7-4eaa-a46c-f094a0d6d0c4 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=4818358a827143eb9ace58a26713cdf0&device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 1099 time: 0.1026707 Nov 08 16:12:14.753967 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 60888) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:14.759248 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-eeb910af-4c0b-4a55-b765-c2784ce51955 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Request body: {'floatingip': {'port_id': 'fbefda08-fc7a-42a0-b714-6dea3d8a5161'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:12:14.761322 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bfb35cf-6fb1-4299-ad11-8e0a002f6b26 req-63029e4a-82a4-43b1-b1b0-43ba3f5bf4d1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:14.762881 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1bfb35cf-6fb1-4299-ad11-8e0a002f6b26 req-63029e4a-82a4-43b1-b1b0-43ba3f5bf4d1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0910993 Nov 08 16:12:14.829758 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-eeb910af-4c0b-4a55-b765-c2784ce51955 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for floatingip, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:14.925912 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1bfb35cf-6fb1-4299-ad11-8e0a002f6b26 req-808dae6c-9d2a-4dcd-b025-92df4db17e96 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1562493 Nov 08 16:12:14.994607 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-572c82de-0c05-4e05-acd4-7ac3138d39fd req-a730b71b-5d8e-4820-9e8d-2e084cbac204 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:14.996377 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-572c82de-0c05-4e05-acd4-7ac3138d39fd req-a730b71b-5d8e-4820-9e8d-2e084cbac204 service neutron] 10.222.0.25 "GET /v2.0/networks?id=2d5b5768-37f3-49a1-b451-2803f6f97429 HTTP/1.1" status: 200 len: 919 time: 0.2193367 Nov 08 16:12:15.053251 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-572c82de-0c05-4e05-acd4-7ac3138d39fd req-733450e5-33d4-4ddb-8168-782fedbefa18 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=3e7ad14a-6975-4075-ac69-3a504ad24341 HTTP/1.1" status: 200 len: 217 time: 0.0406129 Nov 08 16:12:15.141016 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-572c82de-0c05-4e05-acd4-7ac3138d39fd req-a1188790-c9ea-4350-accb-406c0c858025 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:15.145307 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-572c82de-0c05-4e05-acd4-7ac3138d39fd req-a1188790-c9ea-4350-accb-406c0c858025 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=6936707c-bd3f-4cd8-9462-a4af0ea16ed8 HTTP/1.1" status: 200 len: 858 time: 0.0746863 Nov 08 16:12:15.204150 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-572c82de-0c05-4e05-acd4-7ac3138d39fd req-4b8de1d0-c85d-4c1c-b49c-ef6d6ce1920f service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=2d5b5768-37f3-49a1-b451-2803f6f97429&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0482206 Nov 08 16:12:15.417778 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-572c82de-0c05-4e05-acd4-7ac3138d39fd req-97fb5884-7bca-4c96-9548-cb24dc1b4ca8 service neutron] 10.222.0.25 "GET /v2.0/networks/2d5b5768-37f3-49a1-b451-2803f6f97429?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2007189 Nov 08 16:12:15.593224 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-572c82de-0c05-4e05-acd4-7ac3138d39fd req-01e18663-06ff-48a9-ab31-6cc46d1bfa13 service neutron] 10.222.0.25 "GET /v2.0/networks/2d5b5768-37f3-49a1-b451-2803f6f97429?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0971353 Nov 08 16:12:15.719641 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-360be09f-233a-4786-a819-5ee4c7cc6dbd req-d6284ac8-7551-45f8-9997-9f0c89fb4570 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:15.721326 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-360be09f-233a-4786-a819-5ee4c7cc6dbd req-d6284ac8-7551-45f8-9997-9f0c89fb4570 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0602019 Nov 08 16:12:15.786368 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-eeb910af-4c0b-4a55-b765-c2784ce51955 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:15.790261 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-360be09f-233a-4786-a819-5ee4c7cc6dbd req-105adb92-5348-48b0-9e82-acc31f18645a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0619476 Nov 08 16:12:15.792014 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-eeb910af-4c0b-4a55-b765-c2784ce51955 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-2032271'] for floatingip, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:15.910856 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f751dfd-721b-42f5-a2ea-c79d3870104e req-e66e77bb-735e-41f8-a7fb-549abac9015f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:15.912378 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1f751dfd-721b-42f5-a2ea-c79d3870104e req-e66e77bb-735e-41f8-a7fb-549abac9015f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0487669 Nov 08 16:12:15.919660 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.db.l3_db [None req-eeb910af-4c0b-4a55-b765-c2784ce51955 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Floating IP d4af2e67-2c52-4ceb-8852-69c61f0e2870 associated. External IP: 172.27.3.146, port: fbefda08-fc7a-42a0-b714-6dea3d8a5161. Nov 08 16:12:15.921432 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 60948) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:15.926033 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-cfa8aa13-8977-4580-a21d-3ec096d5bd56 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Request body: {'floatingip': {'port_id': 'f4784d76-6af7-4b31-a9f3-ee25c9087b51'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:12:16.030410 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-cfa8aa13-8977-4580-a21d-3ec096d5bd56 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for floatingip, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:16.171589 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eeb910af-4c0b-4a55-b765-c2784ce51955 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Router e5087790-dc76-4f18-81a3-548feaf21791 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101245) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:12:16.200919 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:16.204338 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74b2ee68-f1d6-405f-89aa-b4785adf6cd4 req-a7f345e1-9224-489d-be00-eafa97a9e16e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:16.206196 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-74b2ee68-f1d6-405f-89aa-b4785adf6cd4 req-a7f345e1-9224-489d-be00-eafa97a9e16e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.1949396 Nov 08 16:12:16.301953 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eeb910af-4c0b-4a55-b765-c2784ce51955 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101245) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:12:16.306991 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-eeb910af-4c0b-4a55-b765-c2784ce51955 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for floatingip, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:16.322163 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-205356d4-d55f-4f4a-b41d-c58ff9f1e374 None None] Sync routers for ids ['e5087790-dc76-4f18-81a3-548feaf21791'] in dv-cinder-816187-2-iscsi {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:12:16.339058 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-74b2ee68-f1d6-405f-89aa-b4785adf6cd4 req-a0083726-bd9c-4de0-ab1d-7b471e39849c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0993767 Nov 08 16:12:16.352524 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-205356d4-d55f-4f4a-b41d-c58ff9f1e374 None None] Routers {'e5087790-dc76-4f18-81a3-548feaf21791'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:12:16.352524 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-205356d4-d55f-4f4a-b41d-c58ff9f1e374 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:12:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['e5087790-dc76-4f18-81a3-548feaf21791'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:16.386971 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-eeb910af-4c0b-4a55-b765-c2784ce51955 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "PUT /v2.0/floatingips/d4af2e67-2c52-4ceb-8852-69c61f0e2870 HTTP/1.1" status: 200 len: 991 time: 1.6317630 Nov 08 16:12:16.388030 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1c1c8c8d-5f78-45fb-803d-8f7a84df3433', 'tag': 'fbefda08-fc7a-42a0-b714-6dea3d8a5161'}] {{(pid=101245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:12:16.392225 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9303bddee447de525cefc409d3d14f9dbe8ef1f21bfe9eb24fdef2609d4aa3c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8ed37142-88f0-44eb-81e6-47e3607adcd5" -d '{"events": [{"name": "network-changed", "server_uuid": "1c1c8c8d-5f78-45fb-803d-8f7a84df3433", "tag": "fbefda08-fc7a-42a0-b714-6dea3d8a5161"}]}' {{(pid=101245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:12:16.465883 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-205356d4-d55f-4f4a-b41d-c58ff9f1e374 None None] Set router e5087790-dc76-4f18-81a3-548feaf21791 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:12:16.582200 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:12:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5a0ec4e5-77e1-49f6-9db0-e6945fabfd0f x-openstack-request-id: req-5a0ec4e5-77e1-49f6-9db0-e6945fabfd0f {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:12:16.582491 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1c1c8c8d-5f78-45fb-803d-8f7a84df3433", "tag": "fbefda08-fc7a-42a0-b714-6dea3d8a5161", "status": "completed", "code": 200}]} {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:12:16.582742 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-5a0ec4e5-77e1-49f6-9db0-e6945fabfd0f {{(pid=101245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:12:16.583176 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1c1c8c8d-5f78-45fb-803d-8f7a84df3433', 'tag': 'fbefda08-fc7a-42a0-b714-6dea3d8a5161', 'status': 'completed', 'code': 200} Nov 08 16:12:16.780865 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-205356d4-d55f-4f4a-b41d-c58ff9f1e374 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'name': 'tempest-AttachVolumeShelveTestJSON-1204269590-router', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118'}], 'enable_snat': True}, 'gw_port_id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:01Z', 'updated_at': '2021-11-08T16:11:11Z', 'revision_number': 4, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'gw_port': {'id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:db:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': 'd4af2e67-2c52-4ceb-8852-69c61f0e2870', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'floating_ip_address': '172.27.3.146', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'port_id': 'fbefda08-fc7a-42a0-b714-6dea3d8a5161', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 135, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'mac_address': 'fa:16:3e:13:3c:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1c1c8c8d-5f78-45fb-803d-8f7a84df3433', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:11:20Z', 'updated_at': '2021-11-08T16:12:15Z', 'revision_number': 1, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9e08c20e-219c-4cd8-b6fe-30829b440d06', 'name': '', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'mac_address': 'fa:16:3e:e6:20:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:09Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 5, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'subnets': [{'id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:16.861168 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-205356d4-d55f-4f4a-b41d-c58ff9f1e374 None None] Checking router: e5087790-dc76-4f18-81a3-548feaf21791 for host: dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:12:16.887053 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-205356d4-d55f-4f4a-b41d-c58ff9f1e374 None None] Routers {'e5087790-dc76-4f18-81a3-548feaf21791'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:12:16.888058 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-205356d4-d55f-4f4a-b41d-c58ff9f1e374 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:12:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['e5087790-dc76-4f18-81a3-548feaf21791'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:17.010761 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-205356d4-d55f-4f4a-b41d-c58ff9f1e374 None None] Set router e5087790-dc76-4f18-81a3-548feaf21791 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:12:17.084224 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ed37142-88f0-44eb-81e6-47e3607adcd5 req-5e541efc-c6a3-4ea3-8c38-96937460aaa0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:17.085628 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8ed37142-88f0-44eb-81e6-47e3607adcd5 req-5e541efc-c6a3-4ea3-8c38-96937460aaa0 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=10a4252a63bf480d93d2e9da15bb8efd&device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 1098 time: 0.4566126 Nov 08 16:12:17.242797 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-205356d4-d55f-4f4a-b41d-c58ff9f1e374 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'name': 'tempest-AttachVolumeShelveTestJSON-1204269590-router', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118'}], 'enable_snat': True}, 'gw_port_id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:01Z', 'updated_at': '2021-11-08T16:11:11Z', 'revision_number': 4, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'gw_port': {'id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:db:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': 'd4af2e67-2c52-4ceb-8852-69c61f0e2870', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'floating_ip_address': '172.27.3.146', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'port_id': 'fbefda08-fc7a-42a0-b714-6dea3d8a5161', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 135, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'mac_address': 'fa:16:3e:13:3c:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1c1c8c8d-5f78-45fb-803d-8f7a84df3433', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:11:20Z', 'updated_at': '2021-11-08T16:12:15Z', 'revision_number': 1, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9e08c20e-219c-4cd8-b6fe-30829b440d06', 'name': '', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'mac_address': 'fa:16:3e:e6:20:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:09Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 5, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'subnets': [{'id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:17.272392 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-205356d4-d55f-4f4a-b41d-c58ff9f1e374 None None] The sync data for ids ['e5087790-dc76-4f18-81a3-548feaf21791'] in dv-cinder-816187-2-iscsi is: [{'id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'name': 'tempest-AttachVolumeShelveTestJSON-1204269590-router', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118'}], 'enable_snat': True}, 'gw_port_id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:01Z', 'updated_at': '2021-11-08T16:11:11Z', 'revision_number': 4, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'gw_port': {'id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:db:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': 'd4af2e67-2c52-4ceb-8852-69c61f0e2870', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'floating_ip_address': '172.27.3.146', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'port_id': 'fbefda08-fc7a-42a0-b714-6dea3d8a5161', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 135, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'mac_address': 'fa:16:3e:13:3c:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1c1c8c8d-5f78-45fb-803d-8f7a84df3433', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:11:20Z', 'updated_at': '2021-11-08T16:12:15Z', 'revision_number': 1, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9e08c20e-219c-4cd8-b6fe-30829b440d06', 'name': '', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'mac_address': 'fa:16:3e:e6:20:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:09Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 5, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'subnets': [{'id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:12:17.326035 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ed37142-88f0-44eb-81e6-47e3607adcd5 req-c927b8d2-ab81-42cc-a499-3b3c934f4a19 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:17.327533 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8ed37142-88f0-44eb-81e6-47e3607adcd5 req-c927b8d2-ab81-42cc-a499-3b3c934f4a19 service neutron] 10.222.0.25 "GET /v2.0/networks?id=e0e08679-82fe-47eb-90b6-49a1713fdaca HTTP/1.1" status: 200 len: 918 time: 0.2270510 Nov 08 16:12:17.337867 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-cfa8aa13-8977-4580-a21d-3ec096d5bd56 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:17.342268 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-cfa8aa13-8977-4580-a21d-3ec096d5bd56 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-2032271'] for floatingip, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:17.525561 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53b76ab9-e3c2-4acb-9360-65ecf5dcc96c None None] New status for floating IP d4af2e67-2c52-4ceb-8852-69c61f0e2870: ACTIVE {{(pid=101246) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 16:12:17.565850 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8ed37142-88f0-44eb-81e6-47e3607adcd5 req-023bfa13-d199-4de1-95d7-320c9dce3ef0 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=fbefda08-fc7a-42a0-b714-6dea3d8a5161 HTTP/1.1" status: 200 len: 999 time: 0.2195890 Nov 08 16:12:17.587810 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee5a8887-1192-465f-a284-b97636f233c3 req-a3d69e3c-caa5-47b9-8362-0f71119f3ae0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:17.589319 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ee5a8887-1192-465f-a284-b97636f233c3 req-a3d69e3c-caa5-47b9-8362-0f71119f3ae0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.1631253 Nov 08 16:12:17.624382 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.db.l3_db [None req-cfa8aa13-8977-4580-a21d-3ec096d5bd56 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Floating IP 764e8a8e-25fe-405c-a49e-e34c538b2ec2 associated. External IP: 172.27.3.45, port: f4784d76-6af7-4b31-a9f3-ee25c9087b51. Nov 08 16:12:17.725508 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ed37142-88f0-44eb-81e6-47e3607adcd5 req-0c12b319-5157-463f-84e6-f13ce436ad38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:17.726994 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8ed37142-88f0-44eb-81e6-47e3607adcd5 req-0c12b319-5157-463f-84e6-f13ce436ad38 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=fc52ff8b-1692-487b-a0de-f6290e65d880 HTTP/1.1" status: 200 len: 856 time: 0.1475780 Nov 08 16:12:17.732978 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ee5a8887-1192-465f-a284-b97636f233c3 req-0319fe68-6b6a-4c34-9cc5-57dd633998b7 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1132803 Nov 08 16:12:17.820236 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ed37142-88f0-44eb-81e6-47e3607adcd5 req-172b0799-6e59-4951-93e2-61a6962dc2b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:17.821891 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8ed37142-88f0-44eb-81e6-47e3607adcd5 req-172b0799-6e59-4951-93e2-61a6962dc2b4 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=e0e08679-82fe-47eb-90b6-49a1713fdaca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0605509 Nov 08 16:12:18.001747 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8ed37142-88f0-44eb-81e6-47e3607adcd5 req-708df55d-74b6-47e0-804d-e59d7744974d service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1405172 Nov 08 16:12:18.006216 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cfa8aa13-8977-4580-a21d-3ec096d5bd56 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Router c3f55c44-bed1-4955-9229-dac3c412f010 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:12:18.184370 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8ed37142-88f0-44eb-81e6-47e3607adcd5 req-16ed3e40-3290-4503-8373-8472d39067e3 service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1732376 Nov 08 16:12:18.187179 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cfa8aa13-8977-4580-a21d-3ec096d5bd56 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:12:18.191992 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-cfa8aa13-8977-4580-a21d-3ec096d5bd56 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for floatingip, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:18.200574 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6be09900-39c3-46be-b25a-83e6f8abeecc None None] Sync routers for ids ['c3f55c44-bed1-4955-9229-dac3c412f010'] in dv-cinder-816187-2-iscsi {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:12:18.217384 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6be09900-39c3-46be-b25a-83e6f8abeecc None None] Routers {'c3f55c44-bed1-4955-9229-dac3c412f010'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:12:18.218490 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-6be09900-39c3-46be-b25a-83e6f8abeecc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:12:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['c3f55c44-bed1-4955-9229-dac3c412f010'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:18.258853 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 32836) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:18.365646 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-6be09900-39c3-46be-b25a-83e6f8abeecc None None] Set router c3f55c44-bed1-4955-9229-dac3c412f010 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:12:18.392056 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-92de6b69-dbce-472a-bfa7-4db1013d5c92 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:18.420174 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-cfa8aa13-8977-4580-a21d-3ec096d5bd56 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "PUT /v2.0/floatingips/764e8a8e-25fe-405c-a49e-e34c538b2ec2 HTTP/1.1" status: 200 len: 990 time: 2.4976115 Nov 08 16:12:18.420760 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b76ed94d-63f4-4597-be02-f3fc032b85aa', 'tag': 'f4784d76-6af7-4b31-a9f3-ee25c9087b51'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:12:18.423050 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-33dc3fd7-d7ce-4291-ab3d-2a913b62cf45" -d '{"events": [{"name": "network-changed", "server_uuid": "b76ed94d-63f4-4597-be02-f3fc032b85aa", "tag": "f4784d76-6af7-4b31-a9f3-ee25c9087b51"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:12:18.481804 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:12:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e84fb760-bee4-4176-abc4-6a96b1b72377 x-openstack-request-id: req-e84fb760-bee4-4176-abc4-6a96b1b72377 {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:12:18.482100 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b76ed94d-63f4-4597-be02-f3fc032b85aa", "tag": "f4784d76-6af7-4b31-a9f3-ee25c9087b51", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:12:18.482356 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-e84fb760-bee4-4176-abc4-6a96b1b72377 {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:12:18.482753 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b76ed94d-63f4-4597-be02-f3fc032b85aa', 'tag': 'f4784d76-6af7-4b31-a9f3-ee25c9087b51', 'status': 'completed', 'code': 200} Nov 08 16:12:18.485924 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-92de6b69-dbce-472a-bfa7-4db1013d5c92 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:18.490945 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-92de6b69-dbce-472a-bfa7-4db1013d5c92 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:18.533030 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92de6b69-dbce-472a-bfa7-4db1013d5c92 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=27a63e2c-95c2-4c36-a880-5d487c820b1f,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:18.537787 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-92de6b69-dbce-472a-bfa7-4db1013d5c92 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=46440751aaed4e759c93b40df529b3dd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2771609 Nov 08 16:12:18.541897 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 32844) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:18.548351 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33dc3fd7-d7ce-4291-ab3d-2a913b62cf45 req-9730ffa8-b4bd-4d89-a187-a1903503e7e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:18.549080 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92de6b69-dbce-472a-bfa7-4db1013d5c92 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:18.549417 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92de6b69-dbce-472a-bfa7-4db1013d5c92 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:18.549899 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-33dc3fd7-d7ce-4291-ab3d-2a913b62cf45 req-9730ffa8-b4bd-4d89-a187-a1903503e7e6 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=f6e779f0506643d08d984c2971d5a71c&device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 1098 time: 0.0423620 Nov 08 16:12:18.550210 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92de6b69-dbce-472a-bfa7-4db1013d5c92 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:18.550540 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92de6b69-dbce-472a-bfa7-4db1013d5c92 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:18.550863 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92de6b69-dbce-472a-bfa7-4db1013d5c92 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:18.551186 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92de6b69-dbce-472a-bfa7-4db1013d5c92 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:18.551549 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92de6b69-dbce-472a-bfa7-4db1013d5c92 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:18.551896 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92de6b69-dbce-472a-bfa7-4db1013d5c92 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:18.552194 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92de6b69-dbce-472a-bfa7-4db1013d5c92 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:18.552503 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92de6b69-dbce-472a-bfa7-4db1013d5c92 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:18.552812 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92de6b69-dbce-472a-bfa7-4db1013d5c92 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:18.553117 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92de6b69-dbce-472a-bfa7-4db1013d5c92 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:18.600212 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b9afc014-b717-4505-9aa0-34d434595a35 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:18.630132 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b9afc014-b717-4505-9aa0-34d434595a35 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:18.659279 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33dc3fd7-d7ce-4291-ab3d-2a913b62cf45 req-54f0d1e7-fac1-414c-9f00-36fded23c2c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:18.660857 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-33dc3fd7-d7ce-4291-ab3d-2a913b62cf45 req-54f0d1e7-fac1-414c-9f00-36fded23c2c9 service neutron] 10.222.0.25 "GET /v2.0/networks?id=75fa9c3e-7bfe-490a-9118-221394c29646 HTTP/1.1" status: 200 len: 911 time: 0.0980725 Nov 08 16:12:18.680491 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b9afc014-b717-4505-9aa0-34d434595a35 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:18.683178 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b9afc014-b717-4505-9aa0-34d434595a35 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:18.684564 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-b9afc014-b717-4505-9aa0-34d434595a35 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/27a63e2c-95c2-4c36-a880-5d487c820b1f HTTP/1.1" status: 204 len: 168 time: 0.1416860 Nov 08 16:12:18.709231 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9afc014-b717-4505-9aa0-34d434595a35 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=27a63e2c-95c2-4c36-a880-5d487c820b1f,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:18.753227 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-33dc3fd7-d7ce-4291-ab3d-2a913b62cf45 req-c534eb30-702a-485e-ab8d-e623e29fe196 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f4784d76-6af7-4b31-a9f3-ee25c9087b51 HTTP/1.1" status: 200 len: 998 time: 0.0845213 Nov 08 16:12:18.794177 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-6be09900-39c3-46be-b25a-83e6f8abeecc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'name': 'tempest-AttachVolumeTestJSON-272347721-router', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128'}], 'enable_snat': True}, 'gw_port_id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 4, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'gw_port': {'id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:97:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': '764e8a8e-25fe-405c-a49e-e34c538b2ec2', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'floating_ip_address': '172.27.3.45', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'port_id': 'f4784d76-6af7-4b31-a9f3-ee25c9087b51', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 157, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'mac_address': 'fa:16:3e:55:1f:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b76ed94d-63f4-4597-be02-f3fc032b85aa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:11:30Z', 'updated_at': '2021-11-08T16:12:17Z', 'revision_number': 1, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '30759480-5159-4b6e-a269-86ac7d105870', 'name': '', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'mac_address': 'fa:16:3e:86:ee:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:13Z', 'updated_at': '2021-11-08T16:11:28Z', 'revision_number': 5, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'subnets': [{'id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:18.835724 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6be09900-39c3-46be-b25a-83e6f8abeecc None None] Checking router: c3f55c44-bed1-4955-9229-dac3c412f010 for host: dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:12:18.835964 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33dc3fd7-d7ce-4291-ab3d-2a913b62cf45 req-dfeba26f-2944-4275-894d-ec2968c0e1f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:18.837499 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-33dc3fd7-d7ce-4291-ab3d-2a913b62cf45 req-dfeba26f-2944-4275-894d-ec2968c0e1f6 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=8b248e51-4c70-4980-9452-c6b625bf96dd HTTP/1.1" status: 200 len: 849 time: 0.0656683 Nov 08 16:12:18.847416 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6be09900-39c3-46be-b25a-83e6f8abeecc None None] Routers {'c3f55c44-bed1-4955-9229-dac3c412f010'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:12:18.847416 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-6be09900-39c3-46be-b25a-83e6f8abeecc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:12:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['c3f55c44-bed1-4955-9229-dac3c412f010'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:18.939600 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c599dc20-8b88-4533-b4b2-5ffbfc1873e2 req-1002843d-615e-4db6-8d81-e24b8557e4fb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:18.946849 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c599dc20-8b88-4533-b4b2-5ffbfc1873e2 req-1002843d-615e-4db6-8d81-e24b8557e4fb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0973935 Nov 08 16:12:18.950672 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33dc3fd7-d7ce-4291-ab3d-2a913b62cf45 req-35116574-4b96-49e3-9e27-420983ce4c6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:18.952085 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-33dc3fd7-d7ce-4291-ab3d-2a913b62cf45 req-35116574-4b96-49e3-9e27-420983ce4c6e service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=75fa9c3e-7bfe-490a-9118-221394c29646&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0916390 Nov 08 16:12:18.971052 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-6be09900-39c3-46be-b25a-83e6f8abeecc None None] Set router c3f55c44-bed1-4955-9229-dac3c412f010 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:12:19.066746 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c599dc20-8b88-4533-b4b2-5ffbfc1873e2 req-eb2af29b-3fe9-41d9-9158-fe6742641440 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1045399 Nov 08 16:12:19.104748 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 32864) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:19.118288 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-33dc3fd7-d7ce-4291-ab3d-2a913b62cf45 req-1e0fb410-ca95-4bef-941a-eb84f40acbd2 service neutron] 10.222.0.25 "GET /v2.0/networks/75fa9c3e-7bfe-490a-9118-221394c29646?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1447573 Nov 08 16:12:19.125020 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d81c4e6a-3c45-4aab-bdd3-ea407281f4d8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:19.220233 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d81c4e6a-3c45-4aab-bdd3-ea407281f4d8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:19.225826 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d81c4e6a-3c45-4aab-bdd3-ea407281f4d8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:19.230849 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-33dc3fd7-d7ce-4291-ab3d-2a913b62cf45 req-e394c8fa-d35d-49a5-ac28-a02c41d50100 service neutron] 10.222.0.25 "GET /v2.0/networks/75fa9c3e-7bfe-490a-9118-221394c29646?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0993781 Nov 08 16:12:19.259127 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d81c4e6a-3c45-4aab-bdd3-ea407281f4d8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9fa9bf1f-ea3a-4f6f-b9d1-af5895f385b1,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:19.267784 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-6be09900-39c3-46be-b25a-83e6f8abeecc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'name': 'tempest-AttachVolumeTestJSON-272347721-router', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128'}], 'enable_snat': True}, 'gw_port_id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 4, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'gw_port': {'id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:97:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': '764e8a8e-25fe-405c-a49e-e34c538b2ec2', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'floating_ip_address': '172.27.3.45', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'port_id': 'f4784d76-6af7-4b31-a9f3-ee25c9087b51', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 157, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'mac_address': 'fa:16:3e:55:1f:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b76ed94d-63f4-4597-be02-f3fc032b85aa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:11:30Z', 'updated_at': '2021-11-08T16:12:17Z', 'revision_number': 1, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '30759480-5159-4b6e-a269-86ac7d105870', 'name': '', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'mac_address': 'fa:16:3e:86:ee:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:13Z', 'updated_at': '2021-11-08T16:11:28Z', 'revision_number': 5, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'subnets': [{'id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:19.281197 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-d81c4e6a-3c45-4aab-bdd3-ea407281f4d8 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=7bc463f0561d4ac48a8be44630bb8856&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1752954 Nov 08 16:12:19.283691 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 32868) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:19.297511 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6be09900-39c3-46be-b25a-83e6f8abeecc None None] The sync data for ids ['c3f55c44-bed1-4955-9229-dac3c412f010'] in dv-cinder-816187-2-iscsi is: [{'id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'name': 'tempest-AttachVolumeTestJSON-272347721-router', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128'}], 'enable_snat': True}, 'gw_port_id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 4, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'gw_port': {'id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:97:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': '764e8a8e-25fe-405c-a49e-e34c538b2ec2', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'floating_ip_address': '172.27.3.45', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'port_id': 'f4784d76-6af7-4b31-a9f3-ee25c9087b51', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 157, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'mac_address': 'fa:16:3e:55:1f:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b76ed94d-63f4-4597-be02-f3fc032b85aa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:11:30Z', 'updated_at': '2021-11-08T16:12:17Z', 'revision_number': 1, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '30759480-5159-4b6e-a269-86ac7d105870', 'name': '', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'mac_address': 'fa:16:3e:86:ee:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:13Z', 'updated_at': '2021-11-08T16:11:28Z', 'revision_number': 5, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'subnets': [{'id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:12:19.301831 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 32870) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:19.353463 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-df0c3042-17d1-406e-8942-d578ece96c3a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:19.378775 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-df0c3042-17d1-406e-8942-d578ece96c3a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:19.435272 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-df0c3042-17d1-406e-8942-d578ece96c3a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:19.437756 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-df0c3042-17d1-406e-8942-d578ece96c3a admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:19.441050 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-df0c3042-17d1-406e-8942-d578ece96c3a admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/9fa9bf1f-ea3a-4f6f-b9d1-af5895f385b1 HTTP/1.1" status: 204 len: 168 time: 0.1538448 Nov 08 16:12:19.451938 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df0c3042-17d1-406e-8942-d578ece96c3a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9fa9bf1f-ea3a-4f6f-b9d1-af5895f385b1,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:19.453920 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e3b927af-46e3-4d72-bb16-8ec35555baa6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:19.542427 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e3b927af-46e3-4d72-bb16-8ec35555baa6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:19.550244 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-73295b2f-d2f6-4134-bff7-26dfb3963fae None None] New status for floating IP 764e8a8e-25fe-405c-a49e-e34c538b2ec2: ACTIVE {{(pid=101246) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 16:12:19.553144 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e3b927af-46e3-4d72-bb16-8ec35555baa6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:19.594054 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-e3b927af-46e3-4d72-bb16-8ec35555baa6 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=cc0199aa67ad40ec81e0494f282e0c09&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2875469 Nov 08 16:12:19.596695 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 32880) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:19.611732 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3b927af-46e3-4d72-bb16-8ec35555baa6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=df4bbe9a-9160-4873-ae30-58511bca721f,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:19.652697 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-ac9a969f-ef99-4987-8ac9-e6aba197d298 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:19.690900 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-ac9a969f-ef99-4987-8ac9-e6aba197d298 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:19.744157 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-ac9a969f-ef99-4987-8ac9-e6aba197d298 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:19.747348 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-ac9a969f-ef99-4987-8ac9-e6aba197d298 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:19.749128 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-ac9a969f-ef99-4987-8ac9-e6aba197d298 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/df4bbe9a-9160-4873-ae30-58511bca721f HTTP/1.1" status: 204 len: 168 time: 0.1508284 Nov 08 16:12:19.760915 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac9a969f-ef99-4987-8ac9-e6aba197d298 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=df4bbe9a-9160-4873-ae30-58511bca721f,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:19.769540 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac9a969f-ef99-4987-8ac9-e6aba197d298 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:19.770052 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac9a969f-ef99-4987-8ac9-e6aba197d298 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:19.770929 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac9a969f-ef99-4987-8ac9-e6aba197d298 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:19.771434 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac9a969f-ef99-4987-8ac9-e6aba197d298 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:19.771633 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac9a969f-ef99-4987-8ac9-e6aba197d298 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:19.771899 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac9a969f-ef99-4987-8ac9-e6aba197d298 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:19.772219 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac9a969f-ef99-4987-8ac9-e6aba197d298 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:19.772540 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac9a969f-ef99-4987-8ac9-e6aba197d298 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:19.772856 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac9a969f-ef99-4987-8ac9-e6aba197d298 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:19.773172 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac9a969f-ef99-4987-8ac9-e6aba197d298 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:19.773485 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac9a969f-ef99-4987-8ac9-e6aba197d298 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:19.773817 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac9a969f-ef99-4987-8ac9-e6aba197d298 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:20.090841 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 32910) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:20.105732 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-42ee7c75-51f1-425e-a049-7ef4ec14b082 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:20.222770 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-42ee7c75-51f1-425e-a049-7ef4ec14b082 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:20.231732 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07ef7feb-38d3-4bb5-8c6f-21653b1c0f3f req-2fd80259-c954-443b-92c5-f12722ae0835 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:20.233208 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-07ef7feb-38d3-4bb5-8c6f-21653b1c0f3f req-2fd80259-c954-443b-92c5-f12722ae0835 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0778904 Nov 08 16:12:20.234272 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-42ee7c75-51f1-425e-a049-7ef4ec14b082 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:20.285015 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-42ee7c75-51f1-425e-a049-7ef4ec14b082 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=d2410a309ec349bd88b3b4acdf0a421a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1930165 Nov 08 16:12:20.287046 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42ee7c75-51f1-425e-a049-7ef4ec14b082 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d41fb095-55dc-4aaf-bc6a-702d43583145,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:20.287747 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 32916) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:20.319351 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-07ef7feb-38d3-4bb5-8c6f-21653b1c0f3f req-428a2950-7014-4711-8030-a4069e022ad2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0702081 Nov 08 16:12:20.343374 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-48324751-0880-44c7-a24b-9ed44490add7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:20.372062 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-48324751-0880-44c7-a24b-9ed44490add7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:20.421384 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-48324751-0880-44c7-a24b-9ed44490add7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:20.424120 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-48324751-0880-44c7-a24b-9ed44490add7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:20.425332 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-48324751-0880-44c7-a24b-9ed44490add7 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/d41fb095-55dc-4aaf-bc6a-702d43583145 HTTP/1.1" status: 204 len: 168 time: 0.1365962 Nov 08 16:12:20.433684 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48324751-0880-44c7-a24b-9ed44490add7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d41fb095-55dc-4aaf-bc6a-702d43583145,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:21.447711 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a06f471c-026d-493a-a0ef-5114f9a99cd8 req-e56dfbfd-7443-47a8-8d3a-950fe265b0e9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:21.449455 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a06f471c-026d-493a-a0ef-5114f9a99cd8 req-e56dfbfd-7443-47a8-8d3a-950fe265b0e9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0578065 Nov 08 16:12:21.502088 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a06f471c-026d-493a-a0ef-5114f9a99cd8 req-01dc1dc6-d697-4959-a588-3acf38456091 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461121 Nov 08 16:12:21.601195 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 32988) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:21.703656 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f107bc65-4ba9-4ce3-a6f1-bbb503ca86f7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:21.779809 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f107bc65-4ba9-4ce3-a6f1-bbb503ca86f7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:21.783830 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f107bc65-4ba9-4ce3-a6f1-bbb503ca86f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:21.827280 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-f107bc65-4ba9-4ce3-a6f1-bbb503ca86f7 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=3498fd8b776846039065cb78ff61a21a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2248790 Nov 08 16:12:21.828136 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f107bc65-4ba9-4ce3-a6f1-bbb503ca86f7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5681a42b-84cd-4725-ba03-726d7d81d22c,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:21.829999 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 33000) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:21.882118 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5160a169-9980-41fb-9f68-ddd0aaa872fd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:21.904952 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5160a169-9980-41fb-9f68-ddd0aaa872fd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:21.959535 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5160a169-9980-41fb-9f68-ddd0aaa872fd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:21.962433 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5160a169-9980-41fb-9f68-ddd0aaa872fd admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:21.963803 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-5160a169-9980-41fb-9f68-ddd0aaa872fd admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/5681a42b-84cd-4725-ba03-726d7d81d22c HTTP/1.1" status: 204 len: 168 time: 0.1319909 Nov 08 16:12:21.979306 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5160a169-9980-41fb-9f68-ddd0aaa872fd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5681a42b-84cd-4725-ba03-726d7d81d22c,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:22.259970 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 33024) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:22.365204 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-03e23e54-9e8a-4770-bfb4-467c5a949cb7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:22.450636 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-03e23e54-9e8a-4770-bfb4-467c5a949cb7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:22.454719 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-03e23e54-9e8a-4770-bfb4-467c5a949cb7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:22.495130 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-03e23e54-9e8a-4770-bfb4-467c5a949cb7 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=25e85c3e841b459e8b585f0598e88fac&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2316985 Nov 08 16:12:22.495130 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03e23e54-9e8a-4770-bfb4-467c5a949cb7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f3fe6324-4208-4784-a232-41331cd8bf58,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:22.495695 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 33038) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:22.549370 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-147d8cf0-8e21-4d54-9fe8-82bdae7f0bc7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:22.575113 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-147d8cf0-8e21-4d54-9fe8-82bdae7f0bc7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:22.655613 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8b5d19f-3670-40ce-a4ff-94beaccd87f9 req-dfc32f3e-28c3-4f29-9559-61de400aae70 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:22.662399 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d8b5d19f-3670-40ce-a4ff-94beaccd87f9 req-dfc32f3e-28c3-4f29-9559-61de400aae70 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0691047 Nov 08 16:12:22.675799 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-147d8cf0-8e21-4d54-9fe8-82bdae7f0bc7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:22.678346 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-147d8cf0-8e21-4d54-9fe8-82bdae7f0bc7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:22.679415 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-147d8cf0-8e21-4d54-9fe8-82bdae7f0bc7 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/f3fe6324-4208-4784-a232-41331cd8bf58 HTTP/1.1" status: 204 len: 168 time: 0.1821892 Nov 08 16:12:22.696556 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-147d8cf0-8e21-4d54-9fe8-82bdae7f0bc7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f3fe6324-4208-4784-a232-41331cd8bf58,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:22.733675 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d8b5d19f-3670-40ce-a4ff-94beaccd87f9 req-83b5a95b-ca2f-4d88-af89-78af291e5c95 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0656972 Nov 08 16:12:23.037580 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 33068) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:23.050475 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-4f31265c-2323-452f-b577-2a936c89b7ea admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:23.086684 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 33070) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:23.128666 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-4f31265c-2323-452f-b577-2a936c89b7ea admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:23.133418 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-4f31265c-2323-452f-b577-2a936c89b7ea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:23.175382 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-4f31265c-2323-452f-b577-2a936c89b7ea admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=7708c05465114dc7b1359f7908b06c39&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1366816 Nov 08 16:12:23.176288 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f31265c-2323-452f-b577-2a936c89b7ea admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a0bf82a3-a934-4848-aca9-d941468be7b2,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:23.178600 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 33076) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:23.228319 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-23e74e61-0db8-4732-b3a8-ce4fc2c4e525 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:23.255870 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-23e74e61-0db8-4732-b3a8-ce4fc2c4e525 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:23.266617 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-65d6da2c-9fd4-49db-a611-81c5aa4b92d5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:23.328676 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-23e74e61-0db8-4732-b3a8-ce4fc2c4e525 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:23.331354 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-23e74e61-0db8-4732-b3a8-ce4fc2c4e525 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:23.332974 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-23e74e61-0db8-4732-b3a8-ce4fc2c4e525 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/a0bf82a3-a934-4848-aca9-d941468be7b2 HTTP/1.1" status: 204 len: 168 time: 0.1523242 Nov 08 16:12:23.348091 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23e74e61-0db8-4732-b3a8-ce4fc2c4e525 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a0bf82a3-a934-4848-aca9-d941468be7b2,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:23.408625 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-65d6da2c-9fd4-49db-a611-81c5aa4b92d5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:23.413705 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-65d6da2c-9fd4-49db-a611-81c5aa4b92d5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:23.450661 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-65d6da2c-9fd4-49db-a611-81c5aa4b92d5 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=6c41288f0576426a888033c55548f735&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3629084 Nov 08 16:12:23.451880 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65d6da2c-9fd4-49db-a611-81c5aa4b92d5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=acd4584f-ec8f-41e1-aa45-b23943d2be1b,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:23.453260 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 33084) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:23.502598 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-559b77ec-56df-4b2c-9cf4-8b31f97b0674 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:23.526893 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-559b77ec-56df-4b2c-9cf4-8b31f97b0674 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:23.574082 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-559b77ec-56df-4b2c-9cf4-8b31f97b0674 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:23.576831 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-559b77ec-56df-4b2c-9cf4-8b31f97b0674 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:23.578515 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-559b77ec-56df-4b2c-9cf4-8b31f97b0674 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/acd4584f-ec8f-41e1-aa45-b23943d2be1b HTTP/1.1" status: 204 len: 168 time: 0.1236925 Nov 08 16:12:23.589553 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-559b77ec-56df-4b2c-9cf4-8b31f97b0674 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=acd4584f-ec8f-41e1-aa45-b23943d2be1b,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:23.863498 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2bca9ce-cadd-40d4-9b91-1184accb2878 req-1d0f28c2-ea30-4b90-b5de-2b17ee3ee2b0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:23.866200 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c2bca9ce-cadd-40d4-9b91-1184accb2878 req-1d0f28c2-ea30-4b90-b5de-2b17ee3ee2b0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0516727 Nov 08 16:12:23.915622 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c2bca9ce-cadd-40d4-9b91-1184accb2878 req-16e75c0e-e762-42b7-8dba-3d0ccdec2c6d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426695 Nov 08 16:12:24.320094 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 33142) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:24.543927 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-0ece09ee-a535-40ae-8894-21e0ce089937 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1161956130-network', 'tenant_id': '343d5ca096394f87bea0950aa3811a13'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:12:24.568817 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0ece09ee-a535-40ae-8894-21e0ce089937 admin admin] Made reservation on behalf of 343d5ca096394f87bea0950aa3811a13 for: {'network': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:12:24.571240 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0ece09ee-a535-40ae-8894-21e0ce089937 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for network, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:24.582577 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0ece09ee-a535-40ae-8894-21e0ce089937 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:24.655418 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0ece09ee-a535-40ae-8894-21e0ce089937 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:24.660251 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0ece09ee-a535-40ae-8894-21e0ce089937 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:24.680865 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0ece09ee-a535-40ae-8894-21e0ce089937 admin admin] vlan segment allocate from pool success with {'vlan_id': 161, 'physical_network': 'physnet1'} {{(pid=101245) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 16:12:24.693624 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ece09ee-a535-40ae-8894-21e0ce089937 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=560ce407-0e9f-4321-bc80-d89a35a1affe,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:24.698280 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0ece09ee-a535-40ae-8894-21e0ce089937 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:24.698612 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.db.segments_db [None req-0ece09ee-a535-40ae-8894-21e0ce089937 admin admin] Added segment 1383b9f8-d178-4a90-828c-184fa1886253 of type vlan for network a15e051b-c130-4140-aaf2-a45ea7af5b43 Nov 08 16:12:24.744677 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0ece09ee-a535-40ae-8894-21e0ce089937 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792876766172'] for network, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:24.769752 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0ece09ee-a535-40ae-8894-21e0ce089937 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for network, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:24.771081 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ece09ee-a535-40ae-8894-21e0ce089937 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:24.771596 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0ece09ee-a535-40ae-8894-21e0ce089937 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:24.824316 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-0ece09ee-a535-40ae-8894-21e0ce089937 admin admin] 10.222.0.37 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.5031672 Nov 08 16:12:24.827393 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 33156) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:24.833149 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-0dda8003-058a-45ea-827c-4daf25ef1f07 admin admin] Request body: {'subnet': {'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1161956130-subnet', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'ip_version': 4}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:12:24.841648 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ece09ee-a535-40ae-8894-21e0ce089937 admin admin] Pushing event updated for resources: {'Network': ['ID=a15e051b-c130-4140-aaf2-a45ea7af5b43,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:24.854287 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0dda8003-058a-45ea-827c-4daf25ef1f07 admin admin] Made reservation on behalf of 343d5ca096394f87bea0950aa3811a13 for: {'subnet': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:12:24.856682 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0dda8003-058a-45ea-827c-4daf25ef1f07 admin admin] Publish callbacks [] for subnet, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:24.862664 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Network a15e051b-c130-4140-aaf2-a45ea7af5b43 details requested by agent ovs-agent-dv-cinder-816187-2-iscsi with host dv-cinder-816187-2-iscsi {{(pid=101246) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 16:12:25.058961 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0dda8003-058a-45ea-827c-4daf25ef1f07 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for subnet, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:25.118997 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7c3d755-d375-4afd-b377-eb0170cb786d req-eb6203d1-b227-4fda-9bb2-d52b0aa701ab tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:25.118997 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b7c3d755-d375-4afd-b377-eb0170cb786d req-eb6203d1-b227-4fda-9bb2-d52b0aa701ab tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0952861 Nov 08 16:12:25.167080 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dda8003-058a-45ea-827c-4daf25ef1f07 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6e4d65b1-4f2c-453a-847c-970dff985732,revision_number=0']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:25.182514 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0dda8003-058a-45ea-827c-4daf25ef1f07 admin admin] Checking segment: {'id': '1383b9f8-d178-4a90-828c-184fa1886253', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:12:25.182813 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0dda8003-058a-45ea-827c-4daf25ef1f07 admin admin] Network hostable DHCP agents. Network: a15e051b-c130-4140-aaf2-a45ea7af5b43, hostable agents: ['a7e1e7ee-1ce2-474e-9688-58f0884991a4'], hosted agents: [] {{(pid=101244) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 16:12:25.219271 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b7c3d755-d375-4afd-b377-eb0170cb786d req-1ac3efc7-4903-4ac3-be67-343f2e6e38e7 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1061215 Nov 08 16:12:25.252619 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0dda8003-058a-45ea-827c-4daf25ef1f07 admin admin] Network a15e051b-c130-4140-aaf2-a45ea7af5b43 is scheduled to be hosted by DHCP agent a7e1e7ee-1ce2-474e-9688-58f0884991a4 with binding_index 1 {{(pid=101244) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 16:12:25.267845 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-0dda8003-058a-45ea-827c-4daf25ef1f07 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816187-2-iscsi, a15e051b-c130-4140-aaf2-a45ea7af5b43) {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:12:25.272693 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0dda8003-058a-45ea-827c-4daf25ef1f07 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:25.274081 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0dda8003-058a-45ea-827c-4daf25ef1f07 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for subnet, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:25.278158 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e057aee1-bf8b-47c8-9c7c-26f1e3ea3178 None None] Network a15e051b-c130-4140-aaf2-a45ea7af5b43 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:12:25.295860 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-0dda8003-058a-45ea-827c-4daf25ef1f07 admin admin] 10.222.0.37 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.4673028 Nov 08 16:12:25.298480 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 33176) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:25.304284 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-6ff10537-eb2d-4121-a391-16cc3341fa7b admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:12:25.437640 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6ff10537-eb2d-4121-a391-16cc3341fa7b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-2034701', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-12912'] for router, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:25.438819 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6ff10537-eb2d-4121-a391-16cc3341fa7b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-2034873', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-2032180', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-2080911', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-12873'] for router, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:25.500298 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b9609375-6eb0-4213-b58a-bb5b21f4a263 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp66bc375f-c06b-591f-b467-1ee6ff0ebcc7-a15e051b-c130-4140-aaf2-a45ea7af5b43', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732'}]}} from dv-cinder-816187-2-iscsi. {{(pid=101246) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 08 16:12:25.501142 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-b9609375-6eb0-4213-b58a-bb5b21f4a263 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:25.547626 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6ff10537-eb2d-4121-a391-16cc3341fa7b admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:25.634329 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-5dc35469-5068-42ee-bd85-fc98f1de4a13 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:25.634581 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.db_base_plugin_common [None req-b9609375-6eb0-4213-b58a-bb5b21f4a263 None None] Allocated IP 172.20.0.2 (a15e051b-c130-4140-aaf2-a45ea7af5b43/6e4d65b1-4f2c-453a-847c-970dff985732/7242f5d5-9392-463d-9719-fe795bec2e7c) {{(pid=101246) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:12:25.636129 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-5dc35469-5068-42ee-bd85-fc98f1de4a13 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/networks?id=f70ee550-62a6-48db-bca5-a0b964bbcce9 HTTP/1.1" status: 200 len: 815 time: 0.2227600 Nov 08 16:12:25.709776 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-e39a894c-03e3-4022-926e-27ce9019ca60 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/quotas/549e9715f7424ff5b3b252f354adafe9 HTTP/1.1" status: 200 len: 375 time: 0.0667636 Nov 08 16:12:25.717844 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6ff10537-eb2d-4121-a391-16cc3341fa7b admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:25.781661 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-b9609375-6eb0-4213-b58a-bb5b21f4a263 None None] Publish callbacks [] for port, precommit_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:25.788876 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-b9609375-6eb0-4213-b58a-bb5b21f4a263 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:25.802138 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-cc36c4b2-9952-45c7-8a37-68fab32e73ca tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?tenant_id=549e9715f7424ff5b3b252f354adafe9&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0808437 Nov 08 16:12:25.828820 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b9609375-6eb0-4213-b58a-bb5b21f4a263 None None] Network a15e051b-c130-4140-aaf2-a45ea7af5b43 is already hosted by enough agents. {{(pid=101246) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:12:25.834065 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.scheduler.base_scheduler [None req-b9609375-6eb0-4213-b58a-bb5b21f4a263 None None] Resources bound (agent type, host, resource id): {{(pid=101246) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:12:25.836678 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9609375-6eb0-4213-b58a-bb5b21f4a263 None None] Received port after_create {{(pid=101246) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:12:25.852926 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9609375-6eb0-4213-b58a-bb5b21f4a263 None None] Pushing event updated for resources: {'Port': ['ID=7242f5d5-9392-463d-9719-fe795bec2e7c,revision_number=1']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:25.899428 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-b9609375-6eb0-4213-b58a-bb5b21f4a263 None None] Attempting to bind port 7242f5d5-9392-463d-9719-fe795bec2e7c on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:12:25.900114 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-b9609375-6eb0-4213-b58a-bb5b21f4a263 None None] Attempting to bind port 7242f5d5-9392-463d-9719-fe795bec2e7c by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': '1383b9f8-d178-4a90-828c-184fa1886253', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43'}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:12:25.900114 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9609375-6eb0-4213-b58a-bb5b21f4a263 None None] Attempting to bind port 7242f5d5-9392-463d-9719-fe795bec2e7c on network a15e051b-c130-4140-aaf2-a45ea7af5b43 {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:12:25.905133 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9609375-6eb0-4213-b58a-bb5b21f4a263 None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 12, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:12:25.905499 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9609375-6eb0-4213-b58a-bb5b21f4a263 None None] Checking segment: {'id': '1383b9f8-d178-4a90-828c-184fa1886253', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:12:25.905918 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-b9609375-6eb0-4213-b58a-bb5b21f4a263 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:25.906306 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9609375-6eb0-4213-b58a-bb5b21f4a263 None None] Bound using segment: {'id': '1383b9f8-d178-4a90-828c-184fa1886253', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43'} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:12:25.906875 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-b9609375-6eb0-4213-b58a-bb5b21f4a263 None None] Bound port: 7242f5d5-9392-463d-9719-fe795bec2e7c, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1383b9f8-d178-4a90-828c-184fa1886253', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43'}}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:12:25.907249 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-b9609375-6eb0-4213-b58a-bb5b21f4a263 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:25.916096 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-2fea6b7f-048f-4414-909c-bec1ae6e82dc service neutron] 10.222.0.37 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1049404 Nov 08 16:12:25.970699 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-b9609375-6eb0-4213-b58a-bb5b21f4a263 None None] For port 7242f5d5-9392-463d-9719-fe795bec2e7c, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:12:25.973613 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-b9609375-6eb0-4213-b58a-bb5b21f4a263 None None] For port 7242f5d5-9392-463d-9719-fe795bec2e7c, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=7242f5d5-9392-463d-9719-fe795bec2e7c,segment=NetworkSegment(1383b9f8-d178-4a90-828c-184fa1886253),segment_id=1383b9f8-d178-4a90-828c-184fa1886253)] {{(pid=101246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:12:25.978100 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-b9609375-6eb0-4213-b58a-bb5b21f4a263 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:26.032514 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9609375-6eb0-4213-b58a-bb5b21f4a263 None None] Pushing event updated for resources: {'Port': ['ID=7242f5d5-9392-463d-9719-fe795bec2e7c,revision_number=2']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:26.086847 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6ff10537-eb2d-4121-a391-16cc3341fa7b admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:26.114635 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6ff10537-eb2d-4121-a391-16cc3341fa7b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:26.124518 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-b0a6f29c-00ea-43d9-8732-fb70253fd668 service neutron] 10.222.0.37 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1732969 Nov 08 16:12:26.315262 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [None req-6ff10537-eb2d-4121-a391-16cc3341fa7b admin admin] Allocated IP 172.27.3.224 (68f46265-b42a-49a0-8d57-f9362045cd9b/4728e4be-5a19-43c0-89cf-ced2a190645d/e49748a3-436b-4a68-b6ec-fe25b219855e) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:12:26.458247 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8781d69-c5ef-4249-971e-ef8183960962 req-a4ad9dc4-ebf5-4f1f-aee6-033ed8486b09 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:26.459887 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f8781d69-c5ef-4249-971e-ef8183960962 req-a4ad9dc4-ebf5-4f1f-aee6-033ed8486b09 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.1075575 Nov 08 16:12:26.503899 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-62453fec-69cd-4941-8e09-98224af7ff0f req-f2c067a6-20c6-4748-8ca9-373266def7a1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=333fb179-0416-4534-95d0-4d9f3a9478f0 HTTP/1.1" status: 200 len: 210 time: 0.0383077 Nov 08 16:12:26.521587 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6ff10537-eb2d-4121-a391-16cc3341fa7b admin admin] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:26.570840 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f8781d69-c5ef-4249-971e-ef8183960962 req-b9009516-c6f6-4b49-ae76-4855a34c40a7 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1018817 Nov 08 16:12:26.579300 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6ff10537-eb2d-4121-a391-16cc3341fa7b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:26.626380 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ff10537-eb2d-4121-a391-16cc3341fa7b admin admin] Network 68f46265-b42a-49a0-8d57-f9362045cd9b is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:12:26.632341 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-6ff10537-eb2d-4121-a391-16cc3341fa7b admin admin] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:12:26.636650 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ff10537-eb2d-4121-a391-16cc3341fa7b admin admin] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:12:26.673371 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ff10537-eb2d-4121-a391-16cc3341fa7b admin admin] Pushing event updated for resources: {'Port': ['ID=e49748a3-436b-4a68-b6ec-fe25b219855e,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:26.982569 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 7242f5d5-9392-463d-9719-fe795bec2e7c up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:12:27.043103 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 7242f5d5-9392-463d-9719-fe795bec2e7c triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:27.043755 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:27.098919 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6ff10537-eb2d-4121-a391-16cc3341fa7b admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:27.148781 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:27.158608 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f727684d-8b8d-48a5-8a26-b3055b31b4a2 None None] Network a15e051b-c130-4140-aaf2-a45ea7af5b43 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:12:27.234256 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] For port 7242f5d5-9392-463d-9719-fe795bec2e7c, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=7242f5d5-9392-463d-9719-fe795bec2e7c,segment=NetworkSegment(1383b9f8-d178-4a90-828c-184fa1886253),segment_id=1383b9f8-d178-4a90-828c-184fa1886253)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:12:27.247521 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:27.252327 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6fd97dfd-172e-4ba3-9fae-1737b3fb2dda None None] Provisioning complete for port 7242f5d5-9392-463d-9719-fe795bec2e7c triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:27.252679 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6fd97dfd-172e-4ba3-9fae-1737b3fb2dda None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:27.290680 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6ff10537-eb2d-4121-a391-16cc3341fa7b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-2034870', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-2032353'] for router, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:27.424625 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6ff10537-eb2d-4121-a391-16cc3341fa7b admin admin] Router f80d01f3-bee2-4682-8f4a-92536ad96209 is scheduled to L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f with binding_index 1 {{(pid=101244) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 08 16:12:27.482463 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Pushing event updated for resources: {'Port': ['ID=7242f5d5-9392-463d-9719-fe795bec2e7c,revision_number=3']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:27.539831 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6ff10537-eb2d-4121-a391-16cc3341fa7b admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:12:27.553069 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] Sync routers for ids ['f80d01f3-bee2-4682-8f4a-92536ad96209'] in dv-cinder-816187-2-iscsi {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:12:27.561695 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6ff10537-eb2d-4121-a391-16cc3341fa7b admin admin] Publish callbacks [] for router, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:27.563386 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-6ff10537-eb2d-4121-a391-16cc3341fa7b admin admin] 10.222.0.37 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 2.2638474 Nov 08 16:12:27.565909 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 33230) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:27.571063 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] Routers {'f80d01f3-bee2-4682-8f4a-92536ad96209'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:12:27.578561 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:12:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['f80d01f3-bee2-4682-8f4a-92536ad96209'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:27.690202 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3cd551c8-0421-447e-86aa-a0e0efe513ec req-d00ffe52-5915-4fe7-9a86-11761f4b010e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=333fb179-0416-4534-95d0-4d9f3a9478f0 HTTP/1.1" status: 200 len: 210 time: 0.0332243 Nov 08 16:12:27.718960 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] Set router f80d01f3-bee2-4682-8f4a-92536ad96209 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:12:27.882650 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-236b2636-542b-4647-854c-30254d90f37c None None] Provisioning complete for port 7242f5d5-9392-463d-9719-fe795bec2e7c triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:27.883926 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-236b2636-542b-4647-854c-30254d90f37c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:27.919090 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:12:26Z', 'revision_number': 3, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:26Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:27.961818 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] Checking router: f80d01f3-bee2-4682-8f4a-92536ad96209 for host: dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:12:27.962441 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] Updating router f80d01f3-bee2-4682-8f4a-92536ad96209 port e49748a3-436b-4a68-b6ec-fe25b219855e binding host dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 16:12:27.987471 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a79b6a9-da23-4ee1-b18c-0a259b9d1b95 req-ab7a50ec-ba8c-44c9-ae37-8e0fa9e0ad0e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:27.987830 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:27.989595 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7a79b6a9-da23-4ee1-b18c-0a259b9d1b95 req-ab7a50ec-ba8c-44c9-ae37-8e0fa9e0ad0e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0655842 Nov 08 16:12:28.086555 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7a79b6a9-da23-4ee1-b18c-0a259b9d1b95 req-8e72d60b-53e6-4ede-a4fb-dd11ab21e583 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0770011 Nov 08 16:12:28.135065 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8b54eda4-0429-4e85-85f1-11680193b136 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:28.239006 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] Publish callbacks [] for port, precommit_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:28.244428 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:28.286722 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [None req-8b54eda4-0429-4e85-85f1-11680193b136 admin admin] Allocated IP 172.20.0.1 (a15e051b-c130-4140-aaf2-a45ea7af5b43/6e4d65b1-4f2c-453a-847c-970dff985732/dbdf39d9-310f-42ea-a1f1-4e1b15048b73) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:12:28.299076 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] Attempting to bind port e49748a3-436b-4a68-b6ec-fe25b219855e on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:12:28.299433 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] Attempting to bind port e49748a3-436b-4a68-b6ec-fe25b219855e by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}] {{(pid=101247) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:12:28.299792 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] Attempting to bind port e49748a3-436b-4a68-b6ec-fe25b219855e on network 68f46265-b42a-49a0-8d57-f9362045cd9b {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:12:28.302589 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bcdb006-e513-4a32-b865-4f4e2df0db87 None None] Pushing event updated for resources: {'Port': ['ID=e49748a3-436b-4a68-b6ec-fe25b219855e,revision_number=2']} {{(pid=101247) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:28.309956 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 12, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:12:28.310329 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] Checking segment: {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101247) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:12:28.310715 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:28.311096 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] Bound using segment: {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'} {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:12:28.311550 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] Bound port: e49748a3-436b-4a68-b6ec-fe25b219855e, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}}] {{(pid=101247) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:12:28.311940 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:28.314975 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bcdb006-e513-4a32-b865-4f4e2df0db87 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:28.315332 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bcdb006-e513-4a32-b865-4f4e2df0db87 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:28.315674 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bcdb006-e513-4a32-b865-4f4e2df0db87 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:28.315998 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bcdb006-e513-4a32-b865-4f4e2df0db87 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:28.316320 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bcdb006-e513-4a32-b865-4f4e2df0db87 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:28.317290 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bcdb006-e513-4a32-b865-4f4e2df0db87 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:28.317619 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bcdb006-e513-4a32-b865-4f4e2df0db87 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:28.318007 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bcdb006-e513-4a32-b865-4f4e2df0db87 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:28.318336 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bcdb006-e513-4a32-b865-4f4e2df0db87 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:28.318655 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bcdb006-e513-4a32-b865-4f4e2df0db87 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:28.318984 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bcdb006-e513-4a32-b865-4f4e2df0db87 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:28.319285 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bcdb006-e513-4a32-b865-4f4e2df0db87 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:12:28.376378 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.db [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] For port e49748a3-436b-4a68-b6ec-fe25b219855e, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101247) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:12:28.380554 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.db [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] For port e49748a3-436b-4a68-b6ec-fe25b219855e, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=e49748a3-436b-4a68-b6ec-fe25b219855e,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101247) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:12:28.384830 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:28.401837 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8b54eda4-0429-4e85-85f1-11680193b136 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:28.434332 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] Routers {'f80d01f3-bee2-4682-8f4a-92536ad96209'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:12:28.434590 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8b54eda4-0429-4e85-85f1-11680193b136 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:28.434926 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:12:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['f80d01f3-bee2-4682-8f4a-92536ad96209'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:28.479328 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b54eda4-0429-4e85-85f1-11680193b136 admin admin] Network a15e051b-c130-4140-aaf2-a45ea7af5b43 is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:12:28.484614 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-8b54eda4-0429-4e85-85f1-11680193b136 admin admin] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:12:28.486750 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b54eda4-0429-4e85-85f1-11680193b136 admin admin] Pushing event updated for resources: {'Port': ['ID=dbdf39d9-310f-42ea-a1f1-4e1b15048b73,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:28.489057 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bcdb006-e513-4a32-b865-4f4e2df0db87 None None] Pushing event updated for resources: {'Port': ['ID=e49748a3-436b-4a68-b6ec-fe25b219855e,revision_number=3']} {{(pid=101247) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:28.498201 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b54eda4-0429-4e85-85f1-11680193b136 admin admin] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:12:28.498960 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8b54eda4-0429-4e85-85f1-11680193b136 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-2033204'] for router_interface, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:28.575566 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] Set router f80d01f3-bee2-4682-8f4a-92536ad96209 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:12:28.704447 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-4593e423-fe08-4191-a781-db3cf260e63a None None] Provisioning complete for port dbdf39d9-310f-42ea-a1f1-4e1b15048b73 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:28.705016 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-4593e423-fe08-4191-a781-db3cf260e63a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:28.739484 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-4593e423-fe08-4191-a781-db3cf260e63a None None] Port dbdf39d9-310f-42ea-a1f1-4e1b15048b73 cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:12:28.838091 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8b54eda4-0429-4e85-85f1-11680193b136 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:28.842505 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:12:26Z', 'revision_number': 3, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:28.868096 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0bed4793-249e-4b8b-b2f3-2731e34803ed None None] The sync data for ids ['f80d01f3-bee2-4682-8f4a-92536ad96209'] in dv-cinder-816187-2-iscsi is: [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:12:26Z', 'revision_number': 3, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}] {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:12:28.953370 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 7242f5d5-9392-463d-9719-fe795bec2e7c up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:12:29.008229 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 7242f5d5-9392-463d-9719-fe795bec2e7c triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:29.008590 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:29.009792 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8b54eda4-0429-4e85-85f1-11680193b136 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:29.014619 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8b54eda4-0429-4e85-85f1-11680193b136 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:29.015381 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8b54eda4-0429-4e85-85f1-11680193b136 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1599525', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-2033312'] for router_interface, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:29.098813 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b54eda4-0429-4e85-85f1-11680193b136 admin admin] Pushing event updated for resources: {'Port': ['ID=dbdf39d9-310f-42ea-a1f1-4e1b15048b73,revision_number=2']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:29.154862 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b54eda4-0429-4e85-85f1-11680193b136 admin admin] Network a15e051b-c130-4140-aaf2-a45ea7af5b43 is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:12:29.156215 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-8b54eda4-0429-4e85-85f1-11680193b136 admin admin] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:12:29.290326 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8b54eda4-0429-4e85-85f1-11680193b136 admin admin] Router f80d01f3-bee2-4682-8f4a-92536ad96209 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:12:29.363082 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-ddce36c6-74e6-405b-820c-3f0f19fa67ad None None] Provisioning complete for port dbdf39d9-310f-42ea-a1f1-4e1b15048b73 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:29.363441 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ddce36c6-74e6-405b-820c-3f0f19fa67ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:29.398163 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-ddce36c6-74e6-405b-820c-3f0f19fa67ad None None] Port dbdf39d9-310f-42ea-a1f1-4e1b15048b73 cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:12:29.404240 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8b54eda4-0429-4e85-85f1-11680193b136 admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:12:29.409829 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-8b54eda4-0429-4e85-85f1-11680193b136 admin admin] 10.222.0.37 "PUT /v2.0/routers/f80d01f3-bee2-4682-8f4a-92536ad96209/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8421528 Nov 08 16:12:30.069900 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 33270) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:30.074852 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-9a6c2451-0670-4502-a43e-cabcacb8e6cf admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-931662474-network', 'tenant_id': 'b8c79a72977c4451b0c2fb13bbce6425'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:12:30.096036 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9a6c2451-0670-4502-a43e-cabcacb8e6cf admin admin] Made reservation on behalf of b8c79a72977c4451b0c2fb13bbce6425 for: {'network': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:12:30.098465 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9a6c2451-0670-4502-a43e-cabcacb8e6cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for network, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:30.107273 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9a6c2451-0670-4502-a43e-cabcacb8e6cf admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:30.184183 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9a6c2451-0670-4502-a43e-cabcacb8e6cf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:30.188067 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9a6c2451-0670-4502-a43e-cabcacb8e6cf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:30.215537 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9a6c2451-0670-4502-a43e-cabcacb8e6cf admin admin] vlan segment allocate from pool success with {'vlan_id': 175, 'physical_network': 'physnet1'} {{(pid=101244) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 16:12:30.223073 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a6c2451-0670-4502-a43e-cabcacb8e6cf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1177fc66-b2a1-4b4e-825a-9c747c789357,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:30.229377 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9a6c2451-0670-4502-a43e-cabcacb8e6cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:30.229745 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.db.segments_db [None req-9a6c2451-0670-4502-a43e-cabcacb8e6cf admin admin] Added segment 1c3a289d-7f6e-4095-81e3-d89c2b08dba0 of type vlan for network 840ec990-538f-47e9-ab6a-3f378aa5803e Nov 08 16:12:30.274941 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9a6c2451-0670-4502-a43e-cabcacb8e6cf admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792876766172'] for network, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:30.297921 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9a6c2451-0670-4502-a43e-cabcacb8e6cf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for network, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:30.298897 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a6c2451-0670-4502-a43e-cabcacb8e6cf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:30.299510 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9a6c2451-0670-4502-a43e-cabcacb8e6cf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:30.352693 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] Sync routers for ids ['f80d01f3-bee2-4682-8f4a-92536ad96209'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:12:30.355010 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-9a6c2451-0670-4502-a43e-cabcacb8e6cf admin admin] 10.222.0.37 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.2838984 Nov 08 16:12:30.357576 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 33272) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:30.365818 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-8098399c-6548-4259-a882-8cadb92d4e55 admin admin] Request body: {'subnet': {'network_id': '840ec990-538f-47e9-ab6a-3f378aa5803e', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-931662474-subnet', 'tenant_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'ip_version': 4}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:12:30.367544 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] Routers {'f80d01f3-bee2-4682-8f4a-92536ad96209'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:12:30.368372 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:12:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['f80d01f3-bee2-4682-8f4a-92536ad96209'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:30.370170 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a6c2451-0670-4502-a43e-cabcacb8e6cf admin admin] Pushing event updated for resources: {'Network': ['ID=840ec990-538f-47e9-ab6a-3f378aa5803e,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:30.392229 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8098399c-6548-4259-a882-8cadb92d4e55 admin admin] Made reservation on behalf of b8c79a72977c4451b0c2fb13bbce6425 for: {'subnet': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:12:30.394753 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8098399c-6548-4259-a882-8cadb92d4e55 admin admin] Publish callbacks [] for subnet, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:30.414812 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Network 840ec990-538f-47e9-ab6a-3f378aa5803e details requested by agent ovs-agent-dv-cinder-816187-2-iscsi with host dv-cinder-816187-2-iscsi {{(pid=101246) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 16:12:30.537526 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] Set router f80d01f3-bee2-4682-8f4a-92536ad96209 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:12:30.569418 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8098399c-6548-4259-a882-8cadb92d4e55 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for subnet, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:30.623197 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8098399c-6548-4259-a882-8cadb92d4e55 admin admin] Pushing event updated for resources: {'Subnet': ['ID=bb937a91-aa49-4e37-bf83-705c857a3885,revision_number=0']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:30.632352 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8098399c-6548-4259-a882-8cadb92d4e55 admin admin] Checking segment: {'id': '1c3a289d-7f6e-4095-81e3-d89c2b08dba0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 175, 'network_id': '840ec990-538f-47e9-ab6a-3f378aa5803e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:12:30.632706 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8098399c-6548-4259-a882-8cadb92d4e55 admin admin] Network hostable DHCP agents. Network: 840ec990-538f-47e9-ab6a-3f378aa5803e, hostable agents: ['a7e1e7ee-1ce2-474e-9688-58f0884991a4'], hosted agents: [] {{(pid=101244) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 16:12:30.649519 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8098399c-6548-4259-a882-8cadb92d4e55 admin admin] Network 840ec990-538f-47e9-ab6a-3f378aa5803e is scheduled to be hosted by DHCP agent a7e1e7ee-1ce2-474e-9688-58f0884991a4 with binding_index 1 {{(pid=101244) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 16:12:30.658714 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-8098399c-6548-4259-a882-8cadb92d4e55 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816187-2-iscsi, 840ec990-538f-47e9-ab6a-3f378aa5803e) {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:12:30.662840 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8098399c-6548-4259-a882-8cadb92d4e55 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:30.663437 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8098399c-6548-4259-a882-8cadb92d4e55 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for subnet, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:30.672745 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d45b91a-4fb5-4d68-92be-5cfd97e18803 None None] Network 840ec990-538f-47e9-ab6a-3f378aa5803e requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:12:30.686120 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 33278) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:30.686691 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-8098399c-6548-4259-a882-8cadb92d4e55 admin admin] 10.222.0.37 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.3274481 Nov 08 16:12:30.690897 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-761bc5b3-3510-4108-9bdc-d526a02dbfaa admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-931662474-router', 'tenant_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:12:30.712555 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-761bc5b3-3510-4108-9bdc-d526a02dbfaa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-2034701', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-12912'] for router, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:30.713574 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-761bc5b3-3510-4108-9bdc-d526a02dbfaa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-2034873', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-2032180', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-2080911', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-12873'] for router, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:30.766443 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-761bc5b3-3510-4108-9bdc-d526a02dbfaa admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:30.836173 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 4, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': 'dbdf39d9-310f-42ea-a1f1-4e1b15048b73', 'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'mac_address': 'fa:16:3e:13:ec:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_interface', 'standard_attr_id': 228, 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:28Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 2, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'subnets': [{'id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:30.886579 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] Checking router: f80d01f3-bee2-4682-8f4a-92536ad96209 for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:12:30.886945 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] Updating router f80d01f3-bee2-4682-8f4a-92536ad96209 port dbdf39d9-310f-42ea-a1f1-4e1b15048b73 binding host dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 16:12:30.914489 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd430a88-e6b5-40a5-ae91-83fcd4959ca6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp66bc375f-c06b-591f-b467-1ee6ff0ebcc7-840ec990-538f-47e9-ab6a-3f378aa5803e', 'network_id': '840ec990-538f-47e9-ab6a-3f378aa5803e', 'tenant_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'fixed_ips': [{'subnet_id': 'bb937a91-aa49-4e37-bf83-705c857a3885'}]}} from dv-cinder-816187-2-iscsi. {{(pid=101246) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 08 16:12:30.915339 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-fd430a88-e6b5-40a5-ae91-83fcd4959ca6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:30.915976 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-761bc5b3-3510-4108-9bdc-d526a02dbfaa admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:30.934723 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:31.002907 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device e49748a3-436b-4a68-b6ec-fe25b219855e up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:12:31.207683 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.db_base_plugin_common [None req-fd430a88-e6b5-40a5-ae91-83fcd4959ca6 None None] Allocated IP 172.20.0.2 (840ec990-538f-47e9-ab6a-3f378aa5803e/bb937a91-aa49-4e37-bf83-705c857a3885/80170e07-aa47-42c5-8b3a-7eaefdd07f69) {{(pid=101246) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:12:31.249374 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port e49748a3-436b-4a68-b6ec-fe25b219855e triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:31.249765 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:31.309953 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-761bc5b3-3510-4108-9bdc-d526a02dbfaa admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:31.328109 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-761bc5b3-3510-4108-9bdc-d526a02dbfaa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:31.431215 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_common [None req-761bc5b3-3510-4108-9bdc-d526a02dbfaa admin admin] Allocated IP 172.27.3.79 (68f46265-b42a-49a0-8d57-f9362045cd9b/4728e4be-5a19-43c0-89cf-ced2a190645d/8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8) {{(pid=101245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:12:31.509897 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:31.530343 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] Publish callbacks [] for port, precommit_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:31.538479 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-fd430a88-e6b5-40a5-ae91-83fcd4959ca6 None None] Publish callbacks [] for port, precommit_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:31.542013 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-761bc5b3-3510-4108-9bdc-d526a02dbfaa admin admin] Publish callbacks [] for port, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:31.548419 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:31.550581 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-fd430a88-e6b5-40a5-ae91-83fcd4959ca6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:31.554041 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] For port e49748a3-436b-4a68-b6ec-fe25b219855e, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=e49748a3-436b-4a68-b6ec-fe25b219855e,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:12:31.584856 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-761bc5b3-3510-4108-9bdc-d526a02dbfaa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:31.587587 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:31.608805 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd430a88-e6b5-40a5-ae91-83fcd4959ca6 None None] Network 840ec990-538f-47e9-ab6a-3f378aa5803e is already hosted by enough agents. {{(pid=101246) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:12:31.615550 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.scheduler.base_scheduler [None req-fd430a88-e6b5-40a5-ae91-83fcd4959ca6 None None] Resources bound (agent type, host, resource id): {{(pid=101246) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:12:31.618669 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b01e320f-819c-4171-bd6b-55dcf777b6d2 None None] Pushing event updated for resources: {'Port': ['ID=dbdf39d9-310f-42ea-a1f1-4e1b15048b73,revision_number=3']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:31.620562 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd430a88-e6b5-40a5-ae91-83fcd4959ca6 None None] Received port after_create {{(pid=101246) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:12:31.630954 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-761bc5b3-3510-4108-9bdc-d526a02dbfaa admin admin] Network 68f46265-b42a-49a0-8d57-f9362045cd9b is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:12:31.634240 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-761bc5b3-3510-4108-9bdc-d526a02dbfaa admin admin] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:12:31.638688 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-761bc5b3-3510-4108-9bdc-d526a02dbfaa admin admin] Received port after_create {{(pid=101245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:12:31.641519 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-761bc5b3-3510-4108-9bdc-d526a02dbfaa admin admin] Pushing event updated for resources: {'Port': ['ID=8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:31.733061 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd430a88-e6b5-40a5-ae91-83fcd4959ca6 None None] Pushing event updated for resources: {'Port': ['ID=80170e07-aa47-42c5-8b3a-7eaefdd07f69,revision_number=1']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:31.771201 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] Attempting to bind port dbdf39d9-310f-42ea-a1f1-4e1b15048b73 on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:12:31.771571 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] Attempting to bind port dbdf39d9-310f-42ea-a1f1-4e1b15048b73 by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': '1383b9f8-d178-4a90-828c-184fa1886253', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43'}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:12:31.771926 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] Attempting to bind port dbdf39d9-310f-42ea-a1f1-4e1b15048b73 on network a15e051b-c130-4140-aaf2-a45ea7af5b43 {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:12:31.777194 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-fd430a88-e6b5-40a5-ae91-83fcd4959ca6 None None] Attempting to bind port 80170e07-aa47-42c5-8b3a-7eaefdd07f69 on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:12:31.777553 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-fd430a88-e6b5-40a5-ae91-83fcd4959ca6 None None] Attempting to bind port 80170e07-aa47-42c5-8b3a-7eaefdd07f69 by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': '1c3a289d-7f6e-4095-81e3-d89c2b08dba0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 175, 'network_id': '840ec990-538f-47e9-ab6a-3f378aa5803e'}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:12:31.778552 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd430a88-e6b5-40a5-ae91-83fcd4959ca6 None None] Attempting to bind port 80170e07-aa47-42c5-8b3a-7eaefdd07f69 on network 840ec990-538f-47e9-ab6a-3f378aa5803e {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:12:31.788055 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 12, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:12:31.788564 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] Checking segment: {'id': '1383b9f8-d178-4a90-828c-184fa1886253', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:12:31.788969 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:31.789354 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] Bound using segment: {'id': '1383b9f8-d178-4a90-828c-184fa1886253', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43'} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:12:31.789840 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] Bound port: dbdf39d9-310f-42ea-a1f1-4e1b15048b73, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1383b9f8-d178-4a90-828c-184fa1886253', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43'}}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:12:31.790301 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:31.808335 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd430a88-e6b5-40a5-ae91-83fcd4959ca6 None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 12, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:12:31.808701 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd430a88-e6b5-40a5-ae91-83fcd4959ca6 None None] Checking segment: {'id': '1c3a289d-7f6e-4095-81e3-d89c2b08dba0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 175, 'network_id': '840ec990-538f-47e9-ab6a-3f378aa5803e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:12:31.809094 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-fd430a88-e6b5-40a5-ae91-83fcd4959ca6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:31.809484 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd430a88-e6b5-40a5-ae91-83fcd4959ca6 None None] Bound using segment: {'id': '1c3a289d-7f6e-4095-81e3-d89c2b08dba0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 175, 'network_id': '840ec990-538f-47e9-ab6a-3f378aa5803e'} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:12:31.810394 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-fd430a88-e6b5-40a5-ae91-83fcd4959ca6 None None] Bound port: 80170e07-aa47-42c5-8b3a-7eaefdd07f69, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1c3a289d-7f6e-4095-81e3-d89c2b08dba0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 175, 'network_id': '840ec990-538f-47e9-ab6a-3f378aa5803e'}}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:12:31.810394 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-fd430a88-e6b5-40a5-ae91-83fcd4959ca6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:31.839333 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Pushing event updated for resources: {'Port': ['ID=e49748a3-436b-4a68-b6ec-fe25b219855e,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:31.883094 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-761bc5b3-3510-4108-9bdc-d526a02dbfaa admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:31.910347 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-c12e675a-d5f2-42d5-b54c-05610964bd0d None None] Provisioning complete for port dbdf39d9-310f-42ea-a1f1-4e1b15048b73 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:31.910805 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-c12e675a-d5f2-42d5-b54c-05610964bd0d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:31.966982 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] For port dbdf39d9-310f-42ea-a1f1-4e1b15048b73, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:12:31.969076 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-fd430a88-e6b5-40a5-ae91-83fcd4959ca6 None None] For port 80170e07-aa47-42c5-8b3a-7eaefdd07f69, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:12:31.977154 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-fd430a88-e6b5-40a5-ae91-83fcd4959ca6 None None] For port 80170e07-aa47-42c5-8b3a-7eaefdd07f69, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=80170e07-aa47-42c5-8b3a-7eaefdd07f69,segment=NetworkSegment(1c3a289d-7f6e-4095-81e3-d89c2b08dba0),segment_id=1c3a289d-7f6e-4095-81e3-d89c2b08dba0)] {{(pid=101246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:12:31.987715 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-fd430a88-e6b5-40a5-ae91-83fcd4959ca6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:31.990554 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] For port dbdf39d9-310f-42ea-a1f1-4e1b15048b73, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=dbdf39d9-310f-42ea-a1f1-4e1b15048b73,segment=NetworkSegment(1383b9f8-d178-4a90-828c-184fa1886253),segment_id=1383b9f8-d178-4a90-828c-184fa1886253)] {{(pid=101246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:12:31.993940 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-c12e675a-d5f2-42d5-b54c-05610964bd0d None None] Port dbdf39d9-310f-42ea-a1f1-4e1b15048b73 cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:12:32.002440 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:32.072163 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd430a88-e6b5-40a5-ae91-83fcd4959ca6 None None] Pushing event updated for resources: {'Port': ['ID=80170e07-aa47-42c5-8b3a-7eaefdd07f69,revision_number=2']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:32.075160 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] Routers {'f80d01f3-bee2-4682-8f4a-92536ad96209'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:12:32.075953 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:12:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['f80d01f3-bee2-4682-8f4a-92536ad96209'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:32.100939 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-761bc5b3-3510-4108-9bdc-d526a02dbfaa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-2034870', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-2032353'] for router, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:32.288731 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-761bc5b3-3510-4108-9bdc-d526a02dbfaa admin admin] Router 3a49b33e-62d5-487b-ada9-a5dcfad92e31 is scheduled to L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f with binding_index 1 {{(pid=101245) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 08 16:12:32.368109 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b01e320f-819c-4171-bd6b-55dcf777b6d2 None None] Pushing event updated for resources: {'Port': ['ID=dbdf39d9-310f-42ea-a1f1-4e1b15048b73,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:32.400570 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] Set router f80d01f3-bee2-4682-8f4a-92536ad96209 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:12:32.401663 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-761bc5b3-3510-4108-9bdc-d526a02dbfaa admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101245) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:12:32.414493 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] Sync routers for ids ['3a49b33e-62d5-487b-ada9-a5dcfad92e31'] in dv-cinder-816187-2-iscsi {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:12:32.424684 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] Routers {'3a49b33e-62d5-487b-ada9-a5dcfad92e31'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:12:32.425384 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:12:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['3a49b33e-62d5-487b-ada9-a5dcfad92e31'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:32.428060 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-761bc5b3-3510-4108-9bdc-d526a02dbfaa admin admin] Publish callbacks [] for router, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:32.429271 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-761bc5b3-3510-4108-9bdc-d526a02dbfaa admin admin] 10.222.0.37 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 1.7418120 Nov 08 16:12:32.431986 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 33288) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:32.538570 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] Set router 3a49b33e-62d5-487b-ada9-a5dcfad92e31 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:12:32.564323 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-654f55c1-81a2-4a90-8563-31c1f26d191e None None] Provisioning complete for port dbdf39d9-310f-42ea-a1f1-4e1b15048b73 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:32.564882 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-654f55c1-81a2-4a90-8563-31c1f26d191e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:32.604181 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:12:32.719428 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-654f55c1-81a2-4a90-8563-31c1f26d191e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:32.750337 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 4, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': 'dbdf39d9-310f-42ea-a1f1-4e1b15048b73', 'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'mac_address': 'fa:16:3e:13:ec:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_interface', 'standard_attr_id': 228, 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:28Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 4, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'subnets': [{'id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:32.752334 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a49b33e-62d5-487b-ada9-a5dcfad92e31', 'name': 'tempest-TestVolumeBootPattern-931662474-router', 'tenant_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.79'}], 'enable_snat': True}, 'gw_port_id': '8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:30Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 3, 'project_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'gw_port': {'id': '8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:fc:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a49b33e-62d5-487b-ada9-a5dcfad92e31', 'device_owner': 'network:router_gateway', 'standard_attr_id': 239, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.79', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:31Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:32.784047 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] Checking router: 3a49b33e-62d5-487b-ada9-a5dcfad92e31 for host: dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:12:32.784396 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] Updating router 3a49b33e-62d5-487b-ada9-a5dcfad92e31 port 8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8 binding host dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 16:12:32.792287 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29b09d58-7e84-446a-ba60-a735b8c6e2fb None None] The sync data for ids ['f80d01f3-bee2-4682-8f4a-92536ad96209'] in dv-cinder-816187-2-iscsi is: [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 4, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': 'dbdf39d9-310f-42ea-a1f1-4e1b15048b73', 'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'mac_address': 'fa:16:3e:13:ec:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_interface', 'standard_attr_id': 228, 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:28Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 4, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'subnets': [{'id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:12:32.795128 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-654f55c1-81a2-4a90-8563-31c1f26d191e None None] For port dbdf39d9-310f-42ea-a1f1-4e1b15048b73, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=dbdf39d9-310f-42ea-a1f1-4e1b15048b73,segment=NetworkSegment(1383b9f8-d178-4a90-828c-184fa1886253),segment_id=1383b9f8-d178-4a90-828c-184fa1886253)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:12:32.802687 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-654f55c1-81a2-4a90-8563-31c1f26d191e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:32.819352 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:32.878346 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-654f55c1-81a2-4a90-8563-31c1f26d191e None None] Pushing event updated for resources: {'Port': ['ID=dbdf39d9-310f-42ea-a1f1-4e1b15048b73,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:32.996627 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-03264dbf-dae2-4e7b-8757-9e719887c3eb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:33.213411 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device e49748a3-436b-4a68-b6ec-fe25b219855e up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:12:33.239382 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_common [None req-03264dbf-dae2-4e7b-8757-9e719887c3eb admin admin] Allocated IP 172.20.0.1 (840ec990-538f-47e9-ab6a-3f378aa5803e/bb937a91-aa49-4e37-bf83-705c857a3885/f275a781-b489-47a1-9715-eeec487362a2) {{(pid=101245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:12:33.246339 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] Publish callbacks [] for port, precommit_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:33.253597 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:33.288725 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2acb8040-1def-4ba6-9e78-150af00582c3 None None] Network 840ec990-538f-47e9-ab6a-3f378aa5803e requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:12:33.314116 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] Attempting to bind port 8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8 on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:12:33.314479 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] Attempting to bind port 8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8 by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}] {{(pid=101247) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:12:33.314837 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] Attempting to bind port 8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8 on network 68f46265-b42a-49a0-8d57-f9362045cd9b {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:12:33.318369 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a88db3cc-c345-4a6d-8860-dc2806da0790 None None] Pushing event updated for resources: {'Port': ['ID=8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8,revision_number=2']} {{(pid=101247) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:33.323431 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 12, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:12:33.323823 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] Checking segment: {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101247) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:12:33.324218 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:33.324601 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] Bound using segment: {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'} {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:12:33.325065 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] Bound port: 8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}}] {{(pid=101247) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:12:33.325438 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:33.374287 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-03264dbf-dae2-4e7b-8757-9e719887c3eb admin admin] Publish callbacks [] for port, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:33.385593 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.db [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] For port 8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101247) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:12:33.389261 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.db [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] For port 8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101247) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:12:33.396632 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:33.417190 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-03264dbf-dae2-4e7b-8757-9e719887c3eb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:33.420617 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6e282a08-e942-4c6d-84b6-09a042e088ee None None] Provisioning complete for port 80170e07-aa47-42c5-8b3a-7eaefdd07f69 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:33.421062 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6e282a08-e942-4c6d-84b6-09a042e088ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:33.461543 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a88db3cc-c345-4a6d-8860-dc2806da0790 None None] Pushing event updated for resources: {'Port': ['ID=8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8,revision_number=3']} {{(pid=101247) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:33.467347 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port e49748a3-436b-4a68-b6ec-fe25b219855e triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:33.467794 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:33.480673 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] Routers {'3a49b33e-62d5-487b-ada9-a5dcfad92e31'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:12:33.481897 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:12:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['3a49b33e-62d5-487b-ada9-a5dcfad92e31'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:33.483445 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-03264dbf-dae2-4e7b-8757-9e719887c3eb admin admin] Network 840ec990-538f-47e9-ab6a-3f378aa5803e is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:12:33.486986 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-03264dbf-dae2-4e7b-8757-9e719887c3eb admin admin] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:12:33.495247 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03264dbf-dae2-4e7b-8757-9e719887c3eb admin admin] Received port after_create {{(pid=101245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:12:33.496084 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-03264dbf-dae2-4e7b-8757-9e719887c3eb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-2033204'] for router_interface, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:33.562236 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03264dbf-dae2-4e7b-8757-9e719887c3eb admin admin] Pushing event updated for resources: {'Port': ['ID=f275a781-b489-47a1-9715-eeec487362a2,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:33.597227 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] Set router 3a49b33e-62d5-487b-ada9-a5dcfad92e31 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:12:33.665335 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-03264dbf-dae2-4e7b-8757-9e719887c3eb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:33.794473 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 80170e07-aa47-42c5-8b3a-7eaefdd07f69 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:12:33.852280 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6e282a08-e942-4c6d-84b6-09a042e088ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:33.883331 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-03264dbf-dae2-4e7b-8757-9e719887c3eb admin admin] Publish callbacks [] for port, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:33.892024 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-03264dbf-dae2-4e7b-8757-9e719887c3eb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:33.893428 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-03264dbf-dae2-4e7b-8757-9e719887c3eb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1599525', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-2033312'] for router_interface, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:33.897241 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a49b33e-62d5-487b-ada9-a5dcfad92e31', 'name': 'tempest-TestVolumeBootPattern-931662474-router', 'tenant_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.79'}], 'enable_snat': True}, 'gw_port_id': '8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:30Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 3, 'project_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'gw_port': {'id': '8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:fc:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a49b33e-62d5-487b-ada9-a5dcfad92e31', 'device_owner': 'network:router_gateway', 'standard_attr_id': 239, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.79', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:31Z', 'updated_at': '2021-11-08T16:12:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:33.990654 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b3b09a9-2f6d-4cde-a99d-0c9ceba7dfaa None None] The sync data for ids ['3a49b33e-62d5-487b-ada9-a5dcfad92e31'] in dv-cinder-816187-2-iscsi is: [{'id': '3a49b33e-62d5-487b-ada9-a5dcfad92e31', 'name': 'tempest-TestVolumeBootPattern-931662474-router', 'tenant_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.79'}], 'enable_snat': True}, 'gw_port_id': '8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:30Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 3, 'project_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'gw_port': {'id': '8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:fc:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a49b33e-62d5-487b-ada9-a5dcfad92e31', 'device_owner': 'network:router_gateway', 'standard_attr_id': 239, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.79', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:31Z', 'updated_at': '2021-11-08T16:12:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}] {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:12:34.076956 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-6e282a08-e942-4c6d-84b6-09a042e088ee None None] For port 80170e07-aa47-42c5-8b3a-7eaefdd07f69, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=80170e07-aa47-42c5-8b3a-7eaefdd07f69,segment=NetworkSegment(1c3a289d-7f6e-4095-81e3-d89c2b08dba0),segment_id=1c3a289d-7f6e-4095-81e3-d89c2b08dba0)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:12:34.078134 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ead42689-446a-4e7e-ab8b-4a091cde1f7b req-83b9f546-f315-4592-9841-e436632d1186 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=333fb179-0416-4534-95d0-4d9f3a9478f0 HTTP/1.1" status: 200 len: 210 time: 0.0520139 Nov 08 16:12:34.097019 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6e282a08-e942-4c6d-84b6-09a042e088ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:34.165593 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03264dbf-dae2-4e7b-8757-9e719887c3eb admin admin] Pushing event updated for resources: {'Port': ['ID=f275a781-b489-47a1-9715-eeec487362a2,revision_number=2']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:34.201178 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 80170e07-aa47-42c5-8b3a-7eaefdd07f69 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:34.202545 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:34.272471 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-03264dbf-dae2-4e7b-8757-9e719887c3eb admin admin] Network 840ec990-538f-47e9-ab6a-3f378aa5803e is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:12:34.282326 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-03264dbf-dae2-4e7b-8757-9e719887c3eb admin admin] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:12:34.300886 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e40734a6-63e1-4833-82f5-2b97f36c31ca req-70988935-db12-4017-b973-e9d3fbed80bd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:34.308697 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e40734a6-63e1-4833-82f5-2b97f36c31ca req-70988935-db12-4017-b973-e9d3fbed80bd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.3563073 Nov 08 16:12:34.317544 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e282a08-e942-4c6d-84b6-09a042e088ee None None] Pushing event updated for resources: {'Port': ['ID=80170e07-aa47-42c5-8b3a-7eaefdd07f69,revision_number=3']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:34.407567 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e40734a6-63e1-4833-82f5-2b97f36c31ca req-c909ffe3-7a2a-4d71-a852-68813671d19b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0976894 Nov 08 16:12:34.417842 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-0f81b81f-c4f6-41f9-ba0c-2ffb9fde55b8 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:34.419335 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-0f81b81f-c4f6-41f9-ba0c-2ffb9fde55b8 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.25 "GET /v2.0/networks?id=f70ee550-62a6-48db-bca5-a0b964bbcce9 HTTP/1.1" status: 200 len: 815 time: 0.3395145 Nov 08 16:12:34.445090 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device dbdf39d9-310f-42ea-a1f1-4e1b15048b73 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:12:34.451211 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-3d0546ea-4e8b-462e-b441-2c412c934035 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Request body: {'port': {'device_id': '333fb179-0416-4534-95d0-4d9f3a9478f0', 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9', 'admin_state_up': True, 'tenant_id': '549e9715f7424ff5b3b252f354adafe9'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:12:34.527626 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-03264dbf-dae2-4e7b-8757-9e719887c3eb admin admin] Router 3a49b33e-62d5-487b-ada9-a5dcfad92e31 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101245) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:12:34.557106 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-a5c95255-f7d3-4c39-860a-d328455e7af5 None None] Provisioning complete for port f275a781-b489-47a1-9715-eeec487362a2 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:34.560641 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-a5c95255-f7d3-4c39-860a-d328455e7af5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:34.631291 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port dbdf39d9-310f-42ea-a1f1-4e1b15048b73 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:34.635170 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-3d0546ea-4e8b-462e-b441-2c412c934035 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Made reservation on behalf of 549e9715f7424ff5b3b252f354adafe9 for: {'port': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:12:34.635340 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:34.639839 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-3d0546ea-4e8b-462e-b441-2c412c934035 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:34.772392 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-a5c95255-f7d3-4c39-860a-d328455e7af5 None None] Port f275a781-b489-47a1-9715-eeec487362a2 cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:12:34.782984 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-03264dbf-dae2-4e7b-8757-9e719887c3eb admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101245) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:12:34.801268 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-03264dbf-dae2-4e7b-8757-9e719887c3eb admin admin] 10.222.0.37 "PUT /v2.0/routers/3a49b33e-62d5-487b-ada9-a5dcfad92e31/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3612897 Nov 08 16:12:34.897233 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-a5c95255-f7d3-4c39-860a-d328455e7af5 None None] Provisioning complete for port 80170e07-aa47-42c5-8b3a-7eaefdd07f69 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:34.900499 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-a5c95255-f7d3-4c39-860a-d328455e7af5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:35.029930 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-3d0546ea-4e8b-462e-b441-2c412c934035 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Allocated IP 172.20.0.4 (f70ee550-62a6-48db-bca5-a0b964bbcce9/cd23e532-b366-42a0-82e4-ec7326cf3b48/d14efac8-b33a-4eb0-b610-32a9bf41b972) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:12:35.327965 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-3d0546ea-4e8b-462e-b441-2c412c934035 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:35.341344 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-273ffe44-6fe6-4f9b-b1cd-473d8f6e1590 None None] Provisioning complete for port f275a781-b489-47a1-9715-eeec487362a2 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:35.342172 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-273ffe44-6fe6-4f9b-b1cd-473d8f6e1590 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:35.406955 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-11f4ec4b-becd-466e-83f4-19a4e6cc4b68 req-67ff32a7-1d12-4e75-bd51-ac078baa9314 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=333fb179-0416-4534-95d0-4d9f3a9478f0 HTTP/1.1" status: 200 len: 210 time: 0.1480587 Nov 08 16:12:35.411135 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-3d0546ea-4e8b-462e-b441-2c412c934035 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:35.429791 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['4020a644-ef2e-4dd8-931a-cfccef4e7b15'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:12:35.434924 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-273ffe44-6fe6-4f9b-b1cd-473d8f6e1590 None None] Port f275a781-b489-47a1-9715-eeec487362a2 cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:12:35.451770 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:12:35.532187 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 33336) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:35.537408 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-bd0e1141-ea87-4da8-b9ff-5627c75f6837 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-706634952', 'description': 'tempest-secgroup-smoke-706634952 description', 'project_id': '343d5ca096394f87bea0950aa3811a13'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:12:35.544007 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-3d0546ea-4e8b-462e-b441-2c412c934035 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Network f70ee550-62a6-48db-bca5-a0b964bbcce9 is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:12:35.568680 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-3d0546ea-4e8b-462e-b441-2c412c934035 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:12:35.569219 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bd0e1141-ea87-4da8-b9ff-5627c75f6837 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:35.572045 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:35.572045 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:35.574785 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-3d0546ea-4e8b-462e-b441-2c412c934035 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:12:35.581038 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-3d0546ea-4e8b-462e-b441-2c412c934035 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:35.581695 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-3d0546ea-4e8b-462e-b441-2c412c934035 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:35.595998 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d0546ea-4e8b-462e-b441-2c412c934035 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Pushing event updated for resources: {'Port': ['ID=d14efac8-b33a-4eb0-b610-32a9bf41b972,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:35.602835 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-3d0546ea-4e8b-462e-b441-2c412c934035 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1700535 Nov 08 16:12:35.626656 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-a2b4234b-9329-44d3-badf-a7fe63ad25b7 service neutron] Request body: {'port': {'device_id': '333fb179-0416-4534-95d0-4d9f3a9478f0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81618'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:12:35.637906 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f8283b7-51f9-4b04-b83b-5f7a4a3554c4 req-62fdf38e-bfa1-44c2-a21a-45e2f126d92f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:35.639465 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0f8283b7-51f9-4b04-b83b-5f7a4a3554c4 req-62fdf38e-bfa1-44c2-a21a-45e2f126d92f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.1079102 Nov 08 16:12:35.668893 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bd0e1141-ea87-4da8-b9ff-5627c75f6837 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:35.676948 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bd0e1141-ea87-4da8-b9ff-5627c75f6837 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:35.709455 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bd0e1141-ea87-4da8-b9ff-5627c75f6837 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:35.710977 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-bd0e1141-ea87-4da8-b9ff-5627c75f6837 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.1778052 Nov 08 16:12:35.714328 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 33338) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:35.719386 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-308475e2-5794-4d09-9180-e2e26a1bda8e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Request body: {'security_group_rule': {'security_group_id': 'a52bd5f6-4026-4f07-a3d9-c70ec9af4076', 'project_id': '343d5ca096394f87bea0950aa3811a13', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:12:35.726796 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd0e1141-ea87-4da8-b9ff-5627c75f6837 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a52bd5f6-4026-4f07-a3d9-c70ec9af4076,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:35.739000 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-a2b4234b-9329-44d3-badf-a7fe63ad25b7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:35.762685 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-308475e2-5794-4d09-9180-e2e26a1bda8e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:35.804022 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0f8283b7-51f9-4b04-b83b-5f7a4a3554c4 req-93cb043b-adae-4b60-81dd-804f433d2c92 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1331036 Nov 08 16:12:35.855221 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-308475e2-5794-4d09-9180-e2e26a1bda8e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:35.861264 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-308475e2-5794-4d09-9180-e2e26a1bda8e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:35.868719 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:35.883286 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-308475e2-5794-4d09-9180-e2e26a1bda8e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9d005cd3-0531-4d79-a78c-8cf3a987374a,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:35.893503 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-308475e2-5794-4d09-9180-e2e26a1bda8e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:35.897262 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-308475e2-5794-4d09-9180-e2e26a1bda8e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1791890 Nov 08 16:12:35.897503 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 33342) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:35.902216 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] For port 8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:12:35.903302 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-6875f1ac-cefa-4590-992d-089e95d53103 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Request body: {'security_group_rule': {'security_group_id': 'a52bd5f6-4026-4f07-a3d9-c70ec9af4076', 'project_id': '343d5ca096394f87bea0950aa3811a13', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:12:35.911521 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:35.912382 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 80170e07-aa47-42c5-8b3a-7eaefdd07f69 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:12:35.943098 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6875f1ac-cefa-4590-992d-089e95d53103 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.002984 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Pushing event updated for resources: {'Port': ['ID=8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:36.012944 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6875f1ac-cefa-4590-992d-089e95d53103 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.014138 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 80170e07-aa47-42c5-8b3a-7eaefdd07f69 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:36.014757 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.018237 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6875f1ac-cefa-4590-992d-089e95d53103 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.037748 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6875f1ac-cefa-4590-992d-089e95d53103 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0b4c0c98-107c-4a10-ae2f-afc8d5f30bc0,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:36.053822 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6875f1ac-cefa-4590-992d-089e95d53103 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.055361 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-6875f1ac-cefa-4590-992d-089e95d53103 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1564739 Nov 08 16:12:36.057934 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 33352) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:36.062517 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-c2960097-0c9c-41b3-bb09-549dd5ab38af tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Request body: {'security_group_rule': {'security_group_id': 'a52bd5f6-4026-4f07-a3d9-c70ec9af4076', 'project_id': '343d5ca096394f87bea0950aa3811a13', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:12:36.106378 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c2960097-0c9c-41b3-bb09-549dd5ab38af tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.191461 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c2960097-0c9c-41b3-bb09-549dd5ab38af tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.196083 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c2960097-0c9c-41b3-bb09-549dd5ab38af tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.210640 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2960097-0c9c-41b3-bb09-549dd5ab38af tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=68770351-f6cc-4918-a45c-498389b62370,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:36.236712 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c2960097-0c9c-41b3-bb09-549dd5ab38af tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.239674 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-c2960097-0c9c-41b3-bb09-549dd5ab38af tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1807406 Nov 08 16:12:36.245389 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 33362) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:36.255933 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-e0a8398f-7652-41e3-9723-0a3a7fdf7109 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Request body: {'security_group_rule': {'security_group_id': 'a52bd5f6-4026-4f07-a3d9-c70ec9af4076', 'project_id': '343d5ca096394f87bea0950aa3811a13', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:12:36.261228 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-a2b4234b-9329-44d3-badf-a7fe63ad25b7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d14efac8-b33a-4eb0-b610-32a9bf41b972 {{(pid=101244) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:12:36.270722 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-a2b4234b-9329-44d3-badf-a7fe63ad25b7 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.288566 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.provisioning_blocks [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-a2b4234b-9329-44d3-badf-a7fe63ad25b7 service neutron] Transition to ACTIVE for port object d14efac8-b33a-4eb0-b610-32a9bf41b972 will not be triggered until provisioned by entity L2. {{(pid=101244) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 16:12:36.295961 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-a2b4234b-9329-44d3-badf-a7fe63ad25b7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.303733 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e0a8398f-7652-41e3-9723-0a3a7fdf7109 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.351893 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2b4234b-9329-44d3-badf-a7fe63ad25b7 service neutron] Pushing event updated for resources: {'Port': ['ID=d14efac8-b33a-4eb0-b610-32a9bf41b972,revision_number=2']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:36.405389 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-a2b4234b-9329-44d3-badf-a7fe63ad25b7 service neutron] Attempting to bind port d14efac8-b33a-4eb0-b610-32a9bf41b972 on host hv-cinder-81618 for vnic_type normal with profile {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:12:36.406417 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-a2b4234b-9329-44d3-badf-a7fe63ad25b7 service neutron] Attempting to bind port d14efac8-b33a-4eb0-b610-32a9bf41b972 by drivers openvswitch,hyperv on host hv-cinder-81618 at level 0 using segments [{'id': 'fab7ad78-c438-48e7-8fdb-80ff50b8600c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9'}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:12:36.406876 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-a2b4234b-9329-44d3-badf-a7fe63ad25b7 service neutron] Attempting to bind port d14efac8-b33a-4eb0-b610-32a9bf41b972 on network f70ee550-62a6-48db-bca5-a0b964bbcce9 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:12:36.413437 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-a2b4234b-9329-44d3-badf-a7fe63ad25b7 service neutron] Port d14efac8-b33a-4eb0-b610-32a9bf41b972 on network f70ee550-62a6-48db-bca5-a0b964bbcce9 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81618 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 16:12:36.413871 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-a2b4234b-9329-44d3-badf-a7fe63ad25b7 service neutron] Attempting to bind port d14efac8-b33a-4eb0-b610-32a9bf41b972 on network f70ee550-62a6-48db-bca5-a0b964bbcce9 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:12:36.419725 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-a2b4234b-9329-44d3-badf-a7fe63ad25b7 service neutron] Checking agent: {'id': '54bf9779-c14d-412a-90fc-96b4a6589d5a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81618', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'started_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 12, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:12:36.420405 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-a2b4234b-9329-44d3-badf-a7fe63ad25b7 service neutron] Checking segment: {'id': 'fab7ad78-c438-48e7-8fdb-80ff50b8600c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:12:36.420979 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-a2b4234b-9329-44d3-badf-a7fe63ad25b7 service neutron] Bound using segment: {'id': 'fab7ad78-c438-48e7-8fdb-80ff50b8600c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9'} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:12:36.421826 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-a2b4234b-9329-44d3-badf-a7fe63ad25b7 service neutron] Bound port: d14efac8-b33a-4eb0-b610-32a9bf41b972, host: hv-cinder-81618, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fab7ad78-c438-48e7-8fdb-80ff50b8600c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9'}}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:12:36.423126 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-a2b4234b-9329-44d3-badf-a7fe63ad25b7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.575466 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-a2b4234b-9329-44d3-badf-a7fe63ad25b7 service neutron] For port d14efac8-b33a-4eb0-b610-32a9bf41b972, host hv-cinder-81618, cleared binding levels {{(pid=101244) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:12:36.579685 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-a2b4234b-9329-44d3-badf-a7fe63ad25b7 service neutron] For port d14efac8-b33a-4eb0-b610-32a9bf41b972, host hv-cinder-81618, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=d14efac8-b33a-4eb0-b610-32a9bf41b972,segment=NetworkSegment(fab7ad78-c438-48e7-8fdb-80ff50b8600c),segment_id=fab7ad78-c438-48e7-8fdb-80ff50b8600c)] {{(pid=101244) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:12:36.590998 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e0a8398f-7652-41e3-9723-0a3a7fdf7109 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.592451 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-955b2dbc-4b5c-4feb-b974-9b38c66eb261 req-8ba3fa87-47bf-4fef-92f5-386eee9642c7 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:36.594355 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-955b2dbc-4b5c-4feb-b974-9b38c66eb261 req-8ba3fa87-47bf-4fef-92f5-386eee9642c7 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 946 time: 0.1300921 Nov 08 16:12:36.595618 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e0a8398f-7652-41e3-9723-0a3a7fdf7109 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.606437 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c10e6801-5278-4014-845b-c782fc2e2972 req-ee9e1eaf-b552-4292-b002-14a3fb9bac43 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:36.608094 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c10e6801-5278-4014-845b-c782fc2e2972 req-ee9e1eaf-b552-4292-b002-14a3fb9bac43 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=333fb179-0416-4534-95d0-4d9f3a9478f0 HTTP/1.1" status: 200 len: 943 time: 0.1104188 Nov 08 16:12:36.609179 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-a2b4234b-9329-44d3-badf-a7fe63ad25b7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.615146 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0a8398f-7652-41e3-9723-0a3a7fdf7109 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ff7a6614-7bc2-48e7-b38f-f1e2ed2750c8,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:36.624471 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e0a8398f-7652-41e3-9723-0a3a7fdf7109 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.628554 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-e0a8398f-7652-41e3-9723-0a3a7fdf7109 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3779917 Nov 08 16:12:36.629087 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 33368) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:36.635311 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-7b274de7-ed97-4024-838d-90432a56c8b9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Request body: {'security_group_rule': {'security_group_id': 'a52bd5f6-4026-4f07-a3d9-c70ec9af4076', 'project_id': '343d5ca096394f87bea0950aa3811a13', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:12:36.660820 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.db.securitygroups_db [None req-7b274de7-ed97-4024-838d-90432a56c8b9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Project 343d5ca096394f87bea0950aa3811a13 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 08 16:12:36.664751 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] Sync routers for ids ['3a49b33e-62d5-487b-ada9-a5dcfad92e31'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:12:36.666194 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b274de7-ed97-4024-838d-90432a56c8b9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.674661 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] Routers {'3a49b33e-62d5-487b-ada9-a5dcfad92e31'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:12:36.674795 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-a2b4234b-9329-44d3-badf-a7fe63ad25b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:36.675464 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:12:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['3a49b33e-62d5-487b-ada9-a5dcfad92e31'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:36.675588 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-a2b4234b-9329-44d3-badf-a7fe63ad25b7 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.677476 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-a2b4234b-9329-44d3-badf-a7fe63ad25b7 service neutron] 10.222.0.25 "PUT /v2.0/ports/d14efac8-b33a-4eb0-b610-32a9bf41b972 HTTP/1.1" status: 200 len: 1093 time: 1.0596766 Nov 08 16:12:36.688936 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '333fb179-0416-4534-95d0-4d9f3a9478f0', 'tag': 'd14efac8-b33a-4eb0-b610-32a9bf41b972'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:12:36.693254 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6486a80b-209e-4a23-8f63-c27576ff5ed9" -d '{"events": [{"name": "network-changed", "server_uuid": "333fb179-0416-4534-95d0-4d9f3a9478f0", "tag": "d14efac8-b33a-4eb0-b610-32a9bf41b972"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:12:36.752993 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b274de7-ed97-4024-838d-90432a56c8b9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.756198 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b274de7-ed97-4024-838d-90432a56c8b9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.776082 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b274de7-ed97-4024-838d-90432a56c8b9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=83fdef07-6eb8-44e3-bab1-bc90bc675a8f,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:36.787492 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b274de7-ed97-4024-838d-90432a56c8b9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.791656 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-7b274de7-ed97-4024-838d-90432a56c8b9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1584482 Nov 08 16:12:36.791799 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-955b2dbc-4b5c-4feb-b974-9b38c66eb261 req-84ca0c6d-f985-477d-8192-052e83941b72 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1773024 Nov 08 16:12:36.791921 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 33372) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:36.796582 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-4e41d62a-d932-47b0-9228-138b6cfb8ad3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Request body: {'security_group_rule': {'security_group_id': 'a52bd5f6-4026-4f07-a3d9-c70ec9af4076', 'project_id': '343d5ca096394f87bea0950aa3811a13', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:12:36.816290 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] Set router 3a49b33e-62d5-487b-ada9-a5dcfad92e31 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:12:36.824141 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.db.securitygroups_db [None req-4e41d62a-d932-47b0-9228-138b6cfb8ad3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Project 343d5ca096394f87bea0950aa3811a13 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 08 16:12:36.830045 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4e41d62a-d932-47b0-9228-138b6cfb8ad3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.833021 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2b4234b-9329-44d3-badf-a7fe63ad25b7 service neutron] Pushing event updated for resources: {'Port': ['ID=d14efac8-b33a-4eb0-b610-32a9bf41b972,revision_number=3']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:36.843863 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:12:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d38ec55b-e939-4982-89ef-5ada13471e35 x-openstack-request-id: req-d38ec55b-e939-4982-89ef-5ada13471e35 {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:12:36.843863 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "333fb179-0416-4534-95d0-4d9f3a9478f0", "tag": "d14efac8-b33a-4eb0-b610-32a9bf41b972", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:12:36.843863 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-d38ec55b-e939-4982-89ef-5ada13471e35 {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:12:36.844645 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '333fb179-0416-4534-95d0-4d9f3a9478f0', 'tag': 'd14efac8-b33a-4eb0-b610-32a9bf41b972', 'status': 'completed', 'code': 200} Nov 08 16:12:36.859514 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c10e6801-5278-4014-845b-c782fc2e2972 req-6e96763b-713e-402e-9438-fb0ee8c7c520 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2357998 Nov 08 16:12:36.874952 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-bc196ae2-ce18-484a-9e9a-370a1cd85e74 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:36.883946 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-bc196ae2-ce18-484a-9e9a-370a1cd85e74 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=549e9715f7424ff5b3b252f354adafe9&device_id=333fb179-0416-4534-95d0-4d9f3a9478f0 HTTP/1.1" status: 200 len: 1096 time: 0.1139498 Nov 08 16:12:36.900162 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4e41d62a-d932-47b0-9228-138b6cfb8ad3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.906898 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4e41d62a-d932-47b0-9228-138b6cfb8ad3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.928495 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e41d62a-d932-47b0-9228-138b6cfb8ad3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7942026b-b94e-4fe2-aa18-141e31a8f24c,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:36.939298 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4e41d62a-d932-47b0-9228-138b6cfb8ad3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:36.943746 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-4e41d62a-d932-47b0-9228-138b6cfb8ad3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1474259 Nov 08 16:12:36.949129 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-d54f6948-ea9d-412a-97c8-35e2ee0d8257 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=d14efac8-b33a-4eb0-b610-32a9bf41b972 HTTP/1.1" status: 200 len: 217 time: 0.0439508 Nov 08 16:12:37.022793 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a56e65b-5713-4927-bfb7-3eeb3516f2c8 req-01108f29-e5a4-43e3-b8d7-fa42acbe4360 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:37.024301 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3a56e65b-5713-4927-bfb7-3eeb3516f2c8 req-01108f29-e5a4-43e3-b8d7-fa42acbe4360 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.1143196 Nov 08 16:12:37.026158 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-58f0ab3a-3a4f-4d73-b268-9d208f701505 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:37.027481 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-58f0ab3a-3a4f-4d73-b268-9d208f701505 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=cd23e532-b366-42a0-82e4-ec7326cf3b48 HTTP/1.1" status: 200 len: 855 time: 0.0622690 Nov 08 16:12:37.046014 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a49b33e-62d5-487b-ada9-a5dcfad92e31', 'name': 'tempest-TestVolumeBootPattern-931662474-router', 'tenant_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.79'}], 'enable_snat': True}, 'gw_port_id': '8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:30Z', 'updated_at': '2021-11-08T16:12:33Z', 'revision_number': 4, 'project_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'gw_port': {'id': '8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:fc:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a49b33e-62d5-487b-ada9-a5dcfad92e31', 'device_owner': 'network:router_gateway', 'standard_attr_id': 239, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.79', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:31Z', 'updated_at': '2021-11-08T16:12:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': 'f275a781-b489-47a1-9715-eeec487362a2', 'name': '', 'network_id': '840ec990-538f-47e9-ab6a-3f378aa5803e', 'tenant_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'mac_address': 'fa:16:3e:31:8c:78', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a49b33e-62d5-487b-ada9-a5dcfad92e31', 'device_owner': 'network:router_interface', 'standard_attr_id': 240, 'fixed_ips': [{'subnet_id': 'bb937a91-aa49-4e37-bf83-705c857a3885', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:33Z', 'updated_at': '2021-11-08T16:12:33Z', 'revision_number': 2, 'project_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'subnets': [{'id': 'bb937a91-aa49-4e37-bf83-705c857a3885', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:37.075582 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] Checking router: 3a49b33e-62d5-487b-ada9-a5dcfad92e31 for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:12:37.075840 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] Updating router 3a49b33e-62d5-487b-ada9-a5dcfad92e31 port f275a781-b489-47a1-9715-eeec487362a2 binding host dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 16:12:37.091225 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-fbd4b9dd-cc6f-4778-9ef3-95bbce450c5e service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=f70ee550-62a6-48db-bca5-a0b964bbcce9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0366831 Nov 08 16:12:37.102469 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:37.103997 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3a56e65b-5713-4927-bfb7-3eeb3516f2c8 req-8189a144-4874-436d-a69a-0a9d37e458fa tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0728676 Nov 08 16:12:37.237185 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-fc9e43e6-0f7d-444c-b8bd-735963120fd2 service neutron] 10.222.0.25 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1086245 Nov 08 16:12:37.271804 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:12:37.386285 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:37.386580 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:37.387310 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0fa0ca45-0ca6-4a65-89ea-7542c6d15291 req-c7b30099-cc2d-4389-bba3-7074519191ef service neutron] 10.222.0.25 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1285827 Nov 08 16:12:37.542582 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6486a80b-209e-4a23-8f63-c27576ff5ed9 req-c0fc0c04-9999-4a5f-98f3-dfe74ef17efb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:37.545112 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6486a80b-209e-4a23-8f63-c27576ff5ed9 req-c0fc0c04-9999-4a5f-98f3-dfe74ef17efb service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=549e9715f7424ff5b3b252f354adafe9&device_id=333fb179-0416-4534-95d0-4d9f3a9478f0 HTTP/1.1" status: 200 len: 1096 time: 0.0639529 Nov 08 16:12:37.592612 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] Publish callbacks [] for port, precommit_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:37.603283 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:37.682176 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70aaaafd-cda1-406a-9863-9cb63914fe8d None None] Pushing event updated for resources: {'Port': ['ID=f275a781-b489-47a1-9715-eeec487362a2,revision_number=3']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:37.720372 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] Attempting to bind port f275a781-b489-47a1-9715-eeec487362a2 on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:12:37.720994 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] Attempting to bind port f275a781-b489-47a1-9715-eeec487362a2 by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': '1c3a289d-7f6e-4095-81e3-d89c2b08dba0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 175, 'network_id': '840ec990-538f-47e9-ab6a-3f378aa5803e'}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:12:37.721568 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] Attempting to bind port f275a781-b489-47a1-9715-eeec487362a2 on network 840ec990-538f-47e9-ab6a-3f378aa5803e {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:12:37.725032 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6486a80b-209e-4a23-8f63-c27576ff5ed9 req-a4f1c6f3-5d8e-403d-aa7b-7dcc7f18b5c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:37.727505 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6486a80b-209e-4a23-8f63-c27576ff5ed9 req-a4f1c6f3-5d8e-403d-aa7b-7dcc7f18b5c0 service neutron] 10.222.0.25 "GET /v2.0/networks?id=f70ee550-62a6-48db-bca5-a0b964bbcce9 HTTP/1.1" status: 200 len: 916 time: 0.1132932 Nov 08 16:12:37.730312 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 12, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:12:37.730783 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] Checking segment: {'id': '1c3a289d-7f6e-4095-81e3-d89c2b08dba0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 175, 'network_id': '840ec990-538f-47e9-ab6a-3f378aa5803e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:12:37.731435 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:37.731935 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] Bound using segment: {'id': '1c3a289d-7f6e-4095-81e3-d89c2b08dba0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 175, 'network_id': '840ec990-538f-47e9-ab6a-3f378aa5803e'} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:12:37.735155 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] Bound port: f275a781-b489-47a1-9715-eeec487362a2, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1c3a289d-7f6e-4095-81e3-d89c2b08dba0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 175, 'network_id': '840ec990-538f-47e9-ab6a-3f378aa5803e'}}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:12:37.735568 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:37.841947 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6486a80b-209e-4a23-8f63-c27576ff5ed9 req-19251473-223f-4e83-a4ea-f2cb288800f8 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=d14efac8-b33a-4eb0-b610-32a9bf41b972 HTTP/1.1" status: 200 len: 217 time: 0.0946062 Nov 08 16:12:37.853965 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] For port f275a781-b489-47a1-9715-eeec487362a2, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:12:37.859567 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] For port f275a781-b489-47a1-9715-eeec487362a2, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=f275a781-b489-47a1-9715-eeec487362a2,segment=NetworkSegment(1c3a289d-7f6e-4095-81e3-d89c2b08dba0),segment_id=1c3a289d-7f6e-4095-81e3-d89c2b08dba0)] {{(pid=101246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:12:37.868193 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:37.982286 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70aaaafd-cda1-406a-9863-9cb63914fe8d None None] Pushing event updated for resources: {'Port': ['ID=f275a781-b489-47a1-9715-eeec487362a2,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:37.995421 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6486a80b-209e-4a23-8f63-c27576ff5ed9 req-d8e3196a-b75c-4ce1-9c50-1103d4b53259 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:37.997075 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6486a80b-209e-4a23-8f63-c27576ff5ed9 req-d8e3196a-b75c-4ce1-9c50-1103d4b53259 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=cd23e532-b366-42a0-82e4-ec7326cf3b48 HTTP/1.1" status: 200 len: 855 time: 0.1430418 Nov 08 16:12:38.021003 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 33454) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:38.023754 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] Routers {'3a49b33e-62d5-487b-ada9-a5dcfad92e31'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:12:38.024923 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:12:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['3a49b33e-62d5-487b-ada9-a5dcfad92e31'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:38.069828 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6486a80b-209e-4a23-8f63-c27576ff5ed9 req-005e670d-8529-4b33-a2e1-28e023667bc1 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=f70ee550-62a6-48db-bca5-a0b964bbcce9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0516813 Nov 08 16:12:38.092308 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f392af72-677a-4ff2-b464-000103ca14fb req-c20d9c1f-3028-4f2e-b3e1-75f17af2710f tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:38.095123 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f392af72-677a-4ff2-b464-000103ca14fb req-c20d9c1f-3028-4f2e-b3e1-75f17af2710f tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 946 time: 0.1463668 Nov 08 16:12:38.157921 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-98835d3b-3838-467d-9c5e-e6f462f1b02c None None] Provisioning complete for port f275a781-b489-47a1-9715-eeec487362a2 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:38.157921 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-98835d3b-3838-467d-9c5e-e6f462f1b02c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:38.212944 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-06d62b03-f378-4f33-b5f5-abd7028a6f12 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:38.256399 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a60fbf4d-861d-4c38-8870-354c744421df req-71f2d222-0240-4257-a94f-3c5c45f13095 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:38.260425 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a60fbf4d-861d-4c38-8870-354c744421df req-71f2d222-0240-4257-a94f-3c5c45f13095 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=333fb179-0416-4534-95d0-4d9f3a9478f0 HTTP/1.1" status: 200 len: 943 time: 0.2996640 Nov 08 16:12:38.337881 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-06d62b03-f378-4f33-b5f5-abd7028a6f12 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:38.338089 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-bf2e56dd-c87d-4615-a7d1-100cf65e9609 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:38.345289 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-06d62b03-f378-4f33-b5f5-abd7028a6f12 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:38.376325 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] Set router 3a49b33e-62d5-487b-ada9-a5dcfad92e31 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:12:38.413171 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-06d62b03-f378-4f33-b5f5-abd7028a6f12 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=29627e5b3013410c9394c21001d99e50&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3864319 Nov 08 16:12:38.413455 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 33472) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:38.424198 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06d62b03-f378-4f33-b5f5-abd7028a6f12 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0e657a77-da5a-49f8-a542-34b00446d8b1,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:38.426994 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f392af72-677a-4ff2-b464-000103ca14fb req-0547bd8d-5b7b-4035-937e-d3d58d9edfd8 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2960744 Nov 08 16:12:38.444786 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-98835d3b-3838-467d-9c5e-e6f462f1b02c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:38.453447 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a60fbf4d-861d-4c38-8870-354c744421df req-6429a4ff-da7d-4d02-bb3c-7d4cc31de6ed tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1844282 Nov 08 16:12:38.458079 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6486a80b-209e-4a23-8f63-c27576ff5ed9 req-f1460f09-a19b-42ab-994f-30192f3f3fff service neutron] 10.222.0.25 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3605230 Nov 08 16:12:38.539253 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-13fb317f-942c-48e9-a754-2bc9d49273a8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:38.545413 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-98835d3b-3838-467d-9c5e-e6f462f1b02c None None] For port f275a781-b489-47a1-9715-eeec487362a2, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=f275a781-b489-47a1-9715-eeec487362a2,segment=NetworkSegment(1c3a289d-7f6e-4095-81e3-d89c2b08dba0),segment_id=1c3a289d-7f6e-4095-81e3-d89c2b08dba0)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:12:38.583742 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-98835d3b-3838-467d-9c5e-e6f462f1b02c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:38.616541 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-13fb317f-942c-48e9-a754-2bc9d49273a8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:38.670303 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98835d3b-3838-467d-9c5e-e6f462f1b02c None None] Pushing event updated for resources: {'Port': ['ID=f275a781-b489-47a1-9715-eeec487362a2,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:38.683161 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-13fb317f-942c-48e9-a754-2bc9d49273a8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:38.685943 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-13fb317f-942c-48e9-a754-2bc9d49273a8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:38.689697 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-13fb317f-942c-48e9-a754-2bc9d49273a8 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/0e657a77-da5a-49f8-a542-34b00446d8b1 HTTP/1.1" status: 204 len: 168 time: 0.2723911 Nov 08 16:12:38.700853 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13fb317f-942c-48e9-a754-2bc9d49273a8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e657a77-da5a-49f8-a542-34b00446d8b1,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:38.732094 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-a454d4de-2e8b-4753-bf71-44ce2866e636 None None] Provisioning complete for port f275a781-b489-47a1-9715-eeec487362a2 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:38.732523 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-a454d4de-2e8b-4753-bf71-44ce2866e636 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:38.801445 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a49b33e-62d5-487b-ada9-a5dcfad92e31', 'name': 'tempest-TestVolumeBootPattern-931662474-router', 'tenant_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.79'}], 'enable_snat': True}, 'gw_port_id': '8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:30Z', 'updated_at': '2021-11-08T16:12:33Z', 'revision_number': 4, 'project_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'gw_port': {'id': '8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:fc:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a49b33e-62d5-487b-ada9-a5dcfad92e31', 'device_owner': 'network:router_gateway', 'standard_attr_id': 239, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.79', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:31Z', 'updated_at': '2021-11-08T16:12:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': 'f275a781-b489-47a1-9715-eeec487362a2', 'name': '', 'network_id': '840ec990-538f-47e9-ab6a-3f378aa5803e', 'tenant_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'mac_address': 'fa:16:3e:31:8c:78', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a49b33e-62d5-487b-ada9-a5dcfad92e31', 'device_owner': 'network:router_interface', 'standard_attr_id': 240, 'fixed_ips': [{'subnet_id': 'bb937a91-aa49-4e37-bf83-705c857a3885', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:33Z', 'updated_at': '2021-11-08T16:12:37Z', 'revision_number': 4, 'project_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'subnets': [{'id': 'bb937a91-aa49-4e37-bf83-705c857a3885', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:38.853317 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fa40245-58f3-40c2-9835-ed638c701a5d None None] The sync data for ids ['3a49b33e-62d5-487b-ada9-a5dcfad92e31'] in dv-cinder-816187-2-iscsi is: [{'id': '3a49b33e-62d5-487b-ada9-a5dcfad92e31', 'name': 'tempest-TestVolumeBootPattern-931662474-router', 'tenant_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.79'}], 'enable_snat': True}, 'gw_port_id': '8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:30Z', 'updated_at': '2021-11-08T16:12:33Z', 'revision_number': 4, 'project_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'gw_port': {'id': '8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:fc:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a49b33e-62d5-487b-ada9-a5dcfad92e31', 'device_owner': 'network:router_gateway', 'standard_attr_id': 239, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.79', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:31Z', 'updated_at': '2021-11-08T16:12:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': 'f275a781-b489-47a1-9715-eeec487362a2', 'name': '', 'network_id': '840ec990-538f-47e9-ab6a-3f378aa5803e', 'tenant_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'mac_address': 'fa:16:3e:31:8c:78', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a49b33e-62d5-487b-ada9-a5dcfad92e31', 'device_owner': 'network:router_interface', 'standard_attr_id': 240, 'fixed_ips': [{'subnet_id': 'bb937a91-aa49-4e37-bf83-705c857a3885', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:33Z', 'updated_at': '2021-11-08T16:12:37Z', 'revision_number': 4, 'project_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'subnets': [{'id': 'bb937a91-aa49-4e37-bf83-705c857a3885', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:12:38.955155 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-887aa3e7-3cf1-4d45-a598-48874a1e9ab0 req-c8bc088b-7ed4-49d1-aa63-1c34a3a16c92 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:38.956868 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-887aa3e7-3cf1-4d45-a598-48874a1e9ab0 req-c8bc088b-7ed4-49d1-aa63-1c34a3a16c92 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.3677156 Nov 08 16:12:38.959103 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6486a80b-209e-4a23-8f63-c27576ff5ed9 req-41207579-6fd3-485b-af4a-e4d22e184e89 service neutron] 10.222.0.25 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4832056 Nov 08 16:12:39.018226 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-887aa3e7-3cf1-4d45-a598-48874a1e9ab0 req-e4f60e4d-7ffe-4e6d-a72f-1902daa6fb90 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0506530 Nov 08 16:12:39.082001 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 33482) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:39.095039 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5a7df6af-9de6-4ca8-966c-5cd06a20e6de admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:39.178370 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5a7df6af-9de6-4ca8-966c-5cd06a20e6de admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:39.185443 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5a7df6af-9de6-4ca8-966c-5cd06a20e6de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:39.229893 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-5a7df6af-9de6-4ca8-966c-5cd06a20e6de admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=13069fe717f64ef4b954353246f040e5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1466930 Nov 08 16:12:39.230766 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a7df6af-9de6-4ca8-966c-5cd06a20e6de admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4222f15b-145d-46aa-a818-a4ad6503888a,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:39.232809 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 33484) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:39.261869 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device f275a781-b489-47a1-9715-eeec487362a2 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:12:39.299745 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c7adc9ab-f47d-4b35-bbc1-9bf8098fe870 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:39.326677 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c7adc9ab-f47d-4b35-bbc1-9bf8098fe870 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:39.397379 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c7adc9ab-f47d-4b35-bbc1-9bf8098fe870 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:39.400597 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c7adc9ab-f47d-4b35-bbc1-9bf8098fe870 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:39.405451 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-c7adc9ab-f47d-4b35-bbc1-9bf8098fe870 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/4222f15b-145d-46aa-a818-a4ad6503888a HTTP/1.1" status: 204 len: 168 time: 0.1707134 Nov 08 16:12:39.413984 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7adc9ab-f47d-4b35-bbc1-9bf8098fe870 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4222f15b-145d-46aa-a818-a4ad6503888a,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:39.447500 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port f275a781-b489-47a1-9715-eeec487362a2 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:39.447864 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:39.640537 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6616dd24-04e0-4bd6-a0a9-8e3424e6d2c0 req-042db666-9fe8-42f8-ba1c-b80541698ee3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:39.642337 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6616dd24-04e0-4bd6-a0a9-8e3424e6d2c0 req-042db666-9fe8-42f8-ba1c-b80541698ee3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=333fb179-0416-4534-95d0-4d9f3a9478f0 HTTP/1.1" status: 200 len: 943 time: 0.0770266 Nov 08 16:12:39.651663 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-767d33da-4ddf-4150-99f7-d956bcc463f5 req-aee8ceff-12bb-4708-8ef6-41e13d29f33b tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:39.655123 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-767d33da-4ddf-4150-99f7-d956bcc463f5 req-aee8ceff-12bb-4708-8ef6-41e13d29f33b tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 946 time: 0.1051416 Nov 08 16:12:39.746662 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6616dd24-04e0-4bd6-a0a9-8e3424e6d2c0 req-5325bd9d-e369-4c80-a80d-0bc6202adaf8 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0859587 Nov 08 16:12:39.752743 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-767d33da-4ddf-4150-99f7-d956bcc463f5 req-99610d51-629d-4137-b38e-af6c3a454d89 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0923564 Nov 08 16:12:40.151477 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-315f831b-bca2-49a6-be52-f418ad4b5602 req-f11687d3-8b72-4049-b138-48375c24ca8e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:40.153145 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-315f831b-bca2-49a6-be52-f418ad4b5602 req-f11687d3-8b72-4049-b138-48375c24ca8e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0565727 Nov 08 16:12:40.205588 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-315f831b-bca2-49a6-be52-f418ad4b5602 req-10041246-5b8b-4c6f-9e4e-2f089e19088b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455856 Nov 08 16:12:40.207977 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 33524) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:40.308633 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-47fb8942-5657-4a3a-ab4d-e3557d4fb880 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-791125710-network', 'tenant_id': '859be553d1524a69b404983add5dfd9d'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:12:40.328894 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-47fb8942-5657-4a3a-ab4d-e3557d4fb880 admin admin] Made reservation on behalf of 859be553d1524a69b404983add5dfd9d for: {'network': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:12:40.331175 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-47fb8942-5657-4a3a-ab4d-e3557d4fb880 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for network, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:40.339825 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-47fb8942-5657-4a3a-ab4d-e3557d4fb880 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:40.413162 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-47fb8942-5657-4a3a-ab4d-e3557d4fb880 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:40.417221 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-47fb8942-5657-4a3a-ab4d-e3557d4fb880 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:40.438680 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-47fb8942-5657-4a3a-ab4d-e3557d4fb880 admin admin] vlan segment allocate from pool success with {'vlan_id': 181, 'physical_network': 'physnet1'} {{(pid=101244) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 16:12:40.457820 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-47fb8942-5657-4a3a-ab4d-e3557d4fb880 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:40.458120 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.db.segments_db [None req-47fb8942-5657-4a3a-ab4d-e3557d4fb880 admin admin] Added segment 4508d137-3b5d-45fa-8b97-925e50ef424d of type vlan for network cc2fa33b-1a9d-4b06-98c2-93d61ec5eaa2 Nov 08 16:12:40.459371 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47fb8942-5657-4a3a-ab4d-e3557d4fb880 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f8564259-b49a-4641-9316-603ecdce224e,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:40.502420 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-47fb8942-5657-4a3a-ab4d-e3557d4fb880 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792876766172'] for network, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:40.526422 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-47fb8942-5657-4a3a-ab4d-e3557d4fb880 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for network, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:40.527346 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47fb8942-5657-4a3a-ab4d-e3557d4fb880 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:40.527948 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-47fb8942-5657-4a3a-ab4d-e3557d4fb880 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:40.579368 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-fb3fac4e-c694-4983-8d5f-b9c03cab2a9e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:40.594462 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-47fb8942-5657-4a3a-ab4d-e3557d4fb880 admin admin] 10.222.0.37 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.3852825 Nov 08 16:12:40.597427 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 33530) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:40.603138 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-b20389d0-e6c9-4e48-8ed7-3d840d44912b admin admin] Request body: {'subnet': {'network_id': 'cc2fa33b-1a9d-4b06-98c2-93d61ec5eaa2', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-791125710-subnet', 'tenant_id': '859be553d1524a69b404983add5dfd9d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:12:40.616833 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47fb8942-5657-4a3a-ab4d-e3557d4fb880 admin admin] Pushing event updated for resources: {'Network': ['ID=cc2fa33b-1a9d-4b06-98c2-93d61ec5eaa2,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:40.628834 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Network cc2fa33b-1a9d-4b06-98c2-93d61ec5eaa2 details requested by agent ovs-agent-dv-cinder-816187-2-iscsi with host dv-cinder-816187-2-iscsi {{(pid=101246) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 16:12:40.640128 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b20389d0-e6c9-4e48-8ed7-3d840d44912b admin admin] Made reservation on behalf of 859be553d1524a69b404983add5dfd9d for: {'subnet': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:12:40.641577 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7c8cf30-e7be-4d64-b09f-d3b76917a848 req-96585a2d-6925-4e6e-8af6-d45702f3c1de tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:40.643532 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b20389d0-e6c9-4e48-8ed7-3d840d44912b admin admin] Publish callbacks [] for subnet, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:40.644930 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c7c8cf30-e7be-4d64-b09f-d3b76917a848 req-96585a2d-6925-4e6e-8af6-d45702f3c1de tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.25 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 946 time: 0.0724087 Nov 08 16:12:40.861577 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-c7c8cf30-e7be-4d64-b09f-d3b76917a848 req-3926b219-add0-45f9-b0a8-a59f0e1d4f35 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Deleting port 70c72d16-a0e9-49bb-b7b8-ef436d81a390 {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:12:40.862001 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-c7c8cf30-e7be-4d64-b09f-d3b76917a848 req-3926b219-add0-45f9-b0a8-a59f0e1d4f35 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:40.870778 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b20389d0-e6c9-4e48-8ed7-3d840d44912b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for subnet, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:40.924024 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b20389d0-e6c9-4e48-8ed7-3d840d44912b admin admin] Pushing event updated for resources: {'Subnet': ['ID=463f37da-cc38-415e-8630-f7fdc5741a9c,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:40.937008 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b20389d0-e6c9-4e48-8ed7-3d840d44912b admin admin] Checking segment: {'id': '4508d137-3b5d-45fa-8b97-925e50ef424d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 181, 'network_id': 'cc2fa33b-1a9d-4b06-98c2-93d61ec5eaa2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:12:40.937356 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b20389d0-e6c9-4e48-8ed7-3d840d44912b admin admin] Network hostable DHCP agents. Network: cc2fa33b-1a9d-4b06-98c2-93d61ec5eaa2, hostable agents: ['a7e1e7ee-1ce2-474e-9688-58f0884991a4'], hosted agents: [] {{(pid=101245) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 16:12:40.955976 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b20389d0-e6c9-4e48-8ed7-3d840d44912b admin admin] Network cc2fa33b-1a9d-4b06-98c2-93d61ec5eaa2 is scheduled to be hosted by DHCP agent a7e1e7ee-1ce2-474e-9688-58f0884991a4 with binding_index 1 {{(pid=101245) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 16:12:40.961899 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42aaf829-6339-4082-ab1f-cc2d887dd2ea req-4040de11-9580-4b10-b3fe-17fa071cbb08 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:40.963339 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-42aaf829-6339-4082-ab1f-cc2d887dd2ea req-4040de11-9580-4b10-b3fe-17fa071cbb08 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=333fb179-0416-4534-95d0-4d9f3a9478f0 HTTP/1.1" status: 200 len: 943 time: 0.1360972 Nov 08 16:12:40.965786 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-b20389d0-e6c9-4e48-8ed7-3d840d44912b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816187-2-iscsi, cc2fa33b-1a9d-4b06-98c2-93d61ec5eaa2) {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:12:40.970684 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b20389d0-e6c9-4e48-8ed7-3d840d44912b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:40.971288 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b20389d0-e6c9-4e48-8ed7-3d840d44912b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for subnet, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:40.979554 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4118e316-8383-423a-a291-e2931ac41f3f None None] Network cc2fa33b-1a9d-4b06-98c2-93d61ec5eaa2 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:12:40.997032 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-b20389d0-e6c9-4e48-8ed7-3d840d44912b admin admin] 10.222.0.37 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3979101 Nov 08 16:12:41.011153 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7311ffa-77b1-4356-a2a9-9bd517c7c6c8 req-b904fcae-5de2-4018-8826-0650b23666d9 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:41.012671 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d7311ffa-77b1-4356-a2a9-9bd517c7c6c8 req-b904fcae-5de2-4018-8826-0650b23666d9 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 946 time: 0.1554961 Nov 08 16:12:41.029375 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-c7c8cf30-e7be-4d64-b09f-d3b76917a848 req-3926b219-add0-45f9-b0a8-a59f0e1d4f35 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] For port 70c72d16-a0e9-49bb-b7b8-ef436d81a390, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=70c72d16-a0e9-49bb-b7b8-ef436d81a390,segment=NetworkSegment(297c0462-3903-48e7-a4ef-95b52eec7b18),segment_id=297c0462-3903-48e7-a4ef-95b52eec7b18)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:12:41.029746 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-c7c8cf30-e7be-4d64-b09f-d3b76917a848 req-3926b219-add0-45f9-b0a8-a59f0e1d4f35 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:41.070071 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-c7c8cf30-e7be-4d64-b09f-d3b76917a848 req-3926b219-add0-45f9-b0a8-a59f0e1d4f35 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Calling delete_port for 70c72d16-a0e9-49bb-b7b8-ef436d81a390 owned by compute:nova {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:12:41.126612 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-243cb225-9964-4f0a-a8ed-9eba8ddc17e0 None None] Network cc2fa33b-1a9d-4b06-98c2-93d61ec5eaa2 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:12:41.130784 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-42aaf829-6339-4082-ab1f-cc2d887dd2ea req-eec88df0-2a0f-4350-95d6-13f3bb87915b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1557896 Nov 08 16:12:41.173447 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d7311ffa-77b1-4356-a2a9-9bd517c7c6c8 req-11161625-fa98-4328-b7d1-7c1107441b21 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/security-groups?id=038cdbd7-8cb8-45e1-a69d-0ade6842560f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1460767 Nov 08 16:12:41.324711 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-c7c8cf30-e7be-4d64-b09f-d3b76917a848 req-3926b219-add0-45f9-b0a8-a59f0e1d4f35 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:41.341569 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['70c72d16-a0e9-49bb-b7b8-ef436d81a390'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:12:41.360502 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3926b219-add0-45f9-b0a8-a59f0e1d4f35 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Pushing event deleted for resources: {'Port': ['ID=70c72d16-a0e9-49bb-b7b8-ef436d81a390,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:41.427058 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4104fb82-8524-4b83-b0c5-05f7fbe848f2 req-6b5ae938-b162-4053-b1c8-7142a5bdc1b7 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:41.428599 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4104fb82-8524-4b83-b0c5-05f7fbe848f2 req-6b5ae938-b162-4053-b1c8-7142a5bdc1b7 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.1374371 Nov 08 16:12:41.446682 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-c7c8cf30-e7be-4d64-b09f-d3b76917a848 req-3926b219-add0-45f9-b0a8-a59f0e1d4f35 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] No DVR routers for this DVR port 70c72d16-a0e9-49bb-b7b8-ef436d81a390 on host hv-cinder-81618 {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:12:41.456474 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-c7c8cf30-e7be-4d64-b09f-d3b76917a848 req-3926b219-add0-45f9-b0a8-a59f0e1d4f35 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:41.458745 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c7c8cf30-e7be-4d64-b09f-d3b76917a848 req-3926b219-add0-45f9-b0a8-a59f0e1d4f35 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.25 "DELETE /v2.0/ports/70c72d16-a0e9-49bb-b7b8-ef436d81a390 HTTP/1.1" status: 204 len: 173 time: 0.8055117 Nov 08 16:12:41.459199 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ec4f96b9-4128-4da6-9880-95a0f72fd4e2', 'name': 'network-vif-deleted', 'tag': '70c72d16-a0e9-49bb-b7b8-ef436d81a390'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:12:41.461454 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9431f336-d2fa-40c9-86c0-a4d3285f744b" -d '{"events": [{"server_uuid": "ec4f96b9-4128-4da6-9880-95a0f72fd4e2", "name": "network-vif-deleted", "tag": "70c72d16-a0e9-49bb-b7b8-ef436d81a390"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:12:41.514042 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4104fb82-8524-4b83-b0c5-05f7fbe848f2 req-565814e5-8013-4a13-a8c0-1c2ee16ff12f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0685887 Nov 08 16:12:41.514368 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:41.527354 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device d14efac8-b33a-4eb0-b610-32a9bf41b972 details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:12:41.538581 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:12:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-29e3e6d2-4b7f-4361-a6a3-87927bb6ad0f x-openstack-request-id: req-29e3e6d2-4b7f-4361-a6a3-87927bb6ad0f {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:12:41.538875 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ec4f96b9-4128-4da6-9880-95a0f72fd4e2", "name": "network-vif-deleted", "tag": "70c72d16-a0e9-49bb-b7b8-ef436d81a390", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:12:41.539602 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-29e3e6d2-4b7f-4361-a6a3-87927bb6ad0f {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:12:41.539842 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ec4f96b9-4128-4da6-9880-95a0f72fd4e2', 'name': 'network-vif-deleted', 'tag': '70c72d16-a0e9-49bb-b7b8-ef436d81a390', 'status': 'completed', 'code': 200} Nov 08 16:12:41.625081 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 33562) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:41.630789 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-5943fd9e-dcc2-45cd-9004-62667ea82487 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-892864377-network', 'tenant_id': 'f60f1e307563486baefb5bf234af8cd0'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:12:41.638492 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port d14efac8-b33a-4eb0-b610-32a9bf41b972, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=d14efac8-b33a-4eb0-b610-32a9bf41b972,segment=NetworkSegment(fab7ad78-c438-48e7-8fdb-80ff50b8600c),segment_id=fab7ad78-c438-48e7-8fdb-80ff50b8600c)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:12:41.650382 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5943fd9e-dcc2-45cd-9004-62667ea82487 admin admin] Made reservation on behalf of f60f1e307563486baefb5bf234af8cd0 for: {'network': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:12:41.650598 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': 'd14efac8-b33a-4eb0-b610-32a9bf41b972', 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9', 'port_id': 'd14efac8-b33a-4eb0-b610-32a9bf41b972', 'mac_address': 'fa:16:3e:a0:4e:64', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 173, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cd23e532-b366-42a0-82e4-ec7326cf3b48', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:12:41.652653 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5943fd9e-dcc2-45cd-9004-62667ea82487 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for network, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:41.662127 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5943fd9e-dcc2-45cd-9004-62667ea82487 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:41.688165 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:41.702612 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d14efac8-b33a-4eb0-b610-32a9bf41b972 {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:12:41.723244 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port d14efac8-b33a-4eb0-b610-32a9bf41b972, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=d14efac8-b33a-4eb0-b610-32a9bf41b972,segment=NetworkSegment(fab7ad78-c438-48e7-8fdb-80ff50b8600c),segment_id=fab7ad78-c438-48e7-8fdb-80ff50b8600c)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:12:41.726919 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:41.742822 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5943fd9e-dcc2-45cd-9004-62667ea82487 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:41.746593 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5943fd9e-dcc2-45cd-9004-62667ea82487 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:41.767966 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5943fd9e-dcc2-45cd-9004-62667ea82487 admin admin] vlan segment allocate from pool success with {'vlan_id': 152, 'physical_network': 'physnet1'} {{(pid=101245) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 16:12:41.775429 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=d14efac8-b33a-4eb0-b610-32a9bf41b972,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:41.783675 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5943fd9e-dcc2-45cd-9004-62667ea82487 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:41.784253 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.db.segments_db [None req-5943fd9e-dcc2-45cd-9004-62667ea82487 admin admin] Added segment f0f12789-e0cc-4226-88a3-6badac06d613 of type vlan for network 29f5d55a-1b58-4c4e-8594-67df1305d49e Nov 08 16:12:41.786078 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5943fd9e-dcc2-45cd-9004-62667ea82487 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2a76efba-a39b-4949-bff5-4b18b28d1321,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:41.830922 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5943fd9e-dcc2-45cd-9004-62667ea82487 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792876766172'] for network, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:41.854139 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5943fd9e-dcc2-45cd-9004-62667ea82487 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for network, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:41.855063 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5943fd9e-dcc2-45cd-9004-62667ea82487 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:41.855654 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5943fd9e-dcc2-45cd-9004-62667ea82487 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:41.908840 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-5943fd9e-dcc2-45cd-9004-62667ea82487 admin admin] 10.222.0.37 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.2825079 Nov 08 16:12:41.912155 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 33566) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:41.918635 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-0101e561-bf0b-4a0d-8d88-183f33413be7 admin admin] Request body: {'subnet': {'network_id': '29f5d55a-1b58-4c4e-8594-67df1305d49e', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-892864377-subnet', 'tenant_id': 'f60f1e307563486baefb5bf234af8cd0', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:12:41.920013 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5943fd9e-dcc2-45cd-9004-62667ea82487 admin admin] Pushing event updated for resources: {'Network': ['ID=29f5d55a-1b58-4c4e-8594-67df1305d49e,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:41.933077 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Network 29f5d55a-1b58-4c4e-8594-67df1305d49e details requested by agent ovs-agent-dv-cinder-816187-2-iscsi with host dv-cinder-816187-2-iscsi {{(pid=101246) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 16:12:41.942350 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0101e561-bf0b-4a0d-8d88-183f33413be7 admin admin] Made reservation on behalf of f60f1e307563486baefb5bf234af8cd0 for: {'subnet': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:12:41.944897 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0101e561-bf0b-4a0d-8d88-183f33413be7 admin admin] Publish callbacks [] for subnet, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:42.120039 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0101e561-bf0b-4a0d-8d88-183f33413be7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for subnet, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:42.174782 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0101e561-bf0b-4a0d-8d88-183f33413be7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a4ec70e4-58ed-4fe0-83d4-9b640ac7073b,revision_number=0']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:42.183543 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0101e561-bf0b-4a0d-8d88-183f33413be7 admin admin] Checking segment: {'id': 'f0f12789-e0cc-4226-88a3-6badac06d613', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 152, 'network_id': '29f5d55a-1b58-4c4e-8594-67df1305d49e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:12:42.183901 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0101e561-bf0b-4a0d-8d88-183f33413be7 admin admin] Network hostable DHCP agents. Network: 29f5d55a-1b58-4c4e-8594-67df1305d49e, hostable agents: ['a7e1e7ee-1ce2-474e-9688-58f0884991a4'], hosted agents: [] {{(pid=101244) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 16:12:42.204433 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0101e561-bf0b-4a0d-8d88-183f33413be7 admin admin] Network 29f5d55a-1b58-4c4e-8594-67df1305d49e is scheduled to be hosted by DHCP agent a7e1e7ee-1ce2-474e-9688-58f0884991a4 with binding_index 1 {{(pid=101244) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 16:12:42.216531 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-0101e561-bf0b-4a0d-8d88-183f33413be7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816187-2-iscsi, 29f5d55a-1b58-4c4e-8594-67df1305d49e) {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:12:42.222992 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0101e561-bf0b-4a0d-8d88-183f33413be7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:42.223889 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0101e561-bf0b-4a0d-8d88-183f33413be7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for subnet, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:42.226896 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9eba2d06-0a44-48fc-93d8-a56e734b3712 None None] Network 29f5d55a-1b58-4c4e-8594-67df1305d49e requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:12:42.249199 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-0101e561-bf0b-4a0d-8d88-183f33413be7 admin admin] 10.222.0.37 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3287885 Nov 08 16:12:42.345171 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4a63defe-138e-4b75-ade8-e1116a00ef4c req-a73b1263-87a0-4c33-9f7d-bed063252663 tempest-DeleteServersTestJSON-310179573 tempest-DeleteServersTestJSON-310179573-project] 10.222.0.37 "GET /v2.0/ports?device_id=ec4f96b9-4128-4da6-9880-95a0f72fd4e2 HTTP/1.1" status: 200 len: 210 time: 0.0354128 Nov 08 16:12:42.412546 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a7b42dc3-de26-439e-9656-7b2e76b27a52 None None] Network 29f5d55a-1b58-4c4e-8594-67df1305d49e requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:12:42.435329 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cf70a6c-dcc5-433b-9078-38a3787cead9 req-d69144d4-9877-4ce2-93e0-dbb9fc9325b6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:42.437009 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8cf70a6c-dcc5-433b-9078-38a3787cead9 req-d69144d4-9877-4ce2-93e0-dbb9fc9325b6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=333fb179-0416-4534-95d0-4d9f3a9478f0 HTTP/1.1" status: 200 len: 944 time: 0.0849023 Nov 08 16:12:42.465463 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['d14efac8-b33a-4eb0-b610-32a9bf41b972'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:12:42.510343 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8cf70a6c-dcc5-433b-9078-38a3787cead9 req-10e6a4f3-a5d7-4559-8c08-b4a57e2e83b7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0651124 Nov 08 16:12:42.683678 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e88a5ec4-843a-4365-812a-4396b031eeab req-b3394b61-a380-4b65-a9eb-1ceeb0df57a6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:42.685247 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e88a5ec4-843a-4365-812a-4396b031eeab req-b3394b61-a380-4b65-a9eb-1ceeb0df57a6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0612290 Nov 08 16:12:42.740692 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e88a5ec4-843a-4365-812a-4396b031eeab req-76f2f367-caf4-470f-9a57-a59ebf50c0ff tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497139 Nov 08 16:12:43.237366 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:43.633411 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85fefeee-d2d0-4b38-aba5-cf4317247f8b req-6aefcbda-3a6a-4217-8879-04d2ad813715 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:43.635022 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-85fefeee-d2d0-4b38-aba5-cf4317247f8b req-6aefcbda-3a6a-4217-8879-04d2ad813715 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=333fb179-0416-4534-95d0-4d9f3a9478f0 HTTP/1.1" status: 200 len: 944 time: 0.0533571 Nov 08 16:12:43.693032 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-85fefeee-d2d0-4b38-aba5-cf4317247f8b req-3d86ebd6-c1c1-496c-bfdd-89618f931827 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503011 Nov 08 16:12:43.862799 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9bf2ea-5c0a-4b17-9193-b06b8cb0983d req-1e3b459b-3173-4840-b914-a1540ba3c720 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:43.864369 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fa9bf2ea-5c0a-4b17-9193-b06b8cb0983d req-1e3b459b-3173-4840-b914-a1540ba3c720 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0525646 Nov 08 16:12:43.917195 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fa9bf2ea-5c0a-4b17-9193-b06b8cb0983d req-3de518a0-b7f7-4b7f-804d-1def5c2b4e57 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467236 Nov 08 16:12:43.947312 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:44.839978 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c91e3f20-ad2a-4259-b875-1dadc260f42d req-1e0e4735-5935-4e68-8f2f-57232b106261 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:44.841513 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c91e3f20-ad2a-4259-b875-1dadc260f42d req-1e0e4735-5935-4e68-8f2f-57232b106261 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=333fb179-0416-4534-95d0-4d9f3a9478f0 HTTP/1.1" status: 200 len: 944 time: 0.0528727 Nov 08 16:12:44.847042 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 33644) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:44.894259 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_v2 [None req-3d7f06e0-947d-413c-8cc3-e6e5b7f1cc81 admin admin] Deleting subnet caeb6ff4-65b7-4e61-97f1-b93b8755570e {{(pid=101245) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 16:12:44.897340 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3d7f06e0-947d-413c-8cc3-e6e5b7f1cc81 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:44.899309 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c91e3f20-ad2a-4259-b875-1dadc260f42d req-268e1ac2-c4e3-4347-9dd5-56e78567e50f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0472138 Nov 08 16:12:44.932144 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3d7f06e0-947d-413c-8cc3-e6e5b7f1cc81 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:44.941788 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3d7f06e0-947d-413c-8cc3-e6e5b7f1cc81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-872226'] for subnet, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:45.008401 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3d7f06e0-947d-413c-8cc3-e6e5b7f1cc81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-872235', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for subnet, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:45.032523 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d7f06e0-947d-413c-8cc3-e6e5b7f1cc81 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=caeb6ff4-65b7-4e61-97f1-b93b8755570e,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:45.039000 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3d7f06e0-947d-413c-8cc3-e6e5b7f1cc81 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:45.042661 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f348ad-6906-4b41-bc40-5ee4b8cb018e req-ad0edcd4-f665-4cc4-b2b4-b1896095853b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:45.044158 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-52f348ad-6906-4b41-bc40-5ee4b8cb018e req-ad0edcd4-f665-4cc4-b2b4-b1896095853b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0541379 Nov 08 16:12:45.044696 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 33650) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:45.044851 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-3d7f06e0-947d-413c-8cc3-e6e5b7f1cc81 admin admin] 10.222.0.37 "DELETE /v2.0/subnets/caeb6ff4-65b7-4e61-97f1-b93b8755570e HTTP/1.1" status: 204 len: 168 time: 0.1968172 Nov 08 16:12:45.138863 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1007047'] for network, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:45.150174 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-52f348ad-6906-4b41-bc40-5ee4b8cb018e req-4a71c453-c801-44ea-ab34-e407cd809918 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0889339 Nov 08 16:12:45.231378 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-869719', 'neutron.services.segments.db._delete_segments_for_network-8792877333297'] for network, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:45.251919 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] Subscribe: > segment before_delete 55550000 {{(pid=101244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:12:45.252255 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=101244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:12:45.252990 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=101244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:12:45.253315 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] Subscribe: > port after_create 55550000 {{(pid=101244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:12:45.253631 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] Subscribe: > port after_delete 55550000 {{(pid=101244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:12:45.254014 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] Subscribe: > port after_update 55550000 {{(pid=101244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:12:45.254327 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] Subscribe: > segment after_delete 55550000 {{(pid=101244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:12:45.254655 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] Subscribe: > subnet after_create 55550000 {{(pid=101244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:12:45.254967 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=101244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:12:45.255280 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] Subscribe: > subnet after_update 55550000 {{(pid=101244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:12:45.398878 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] Subscribe: > subnet after_create 55550000 {{(pid=101244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:12:45.398878 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=101244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:12:45.398878 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] Subscribe: > subnet before_create 55550000 {{(pid=101244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:12:45.398878 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] Subscribe: > subnet before_update 55550000 {{(pid=101244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:12:45.399324 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8d351af8-ed05-48f5-939b-8cf227b5c91c']}} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:45.420152 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '297c0462-3903-48e7-a4ef-95b52eec7b18') {'for_net_delete': True} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:45.420455 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '297c0462-3903-48e7-a4ef-95b52eec7b18') {} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:12:45.444897 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792877333818', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8047118'] for segment, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:45.465419 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:45.476075 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] Releasing vlan 163 on physical network physnet1 to pool {{(pid=101244) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 16:12:45.477206 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4227628'] for segment, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: from cryptography.utils import int_from_bytes Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: from cryptography.utils import int_from_bytes Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: Traceback (most recent call last): Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: timer() Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: cb(*args, **kw) Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: return func(*args, **kwargs) Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: self._notify() Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: self.callback(batched_events) Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: event.method(event) Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: return f(self, *a, **k) Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: return self._get(url).json() Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: return self.request(url, 'GET', **kwargs) Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 16:12:45.506005 dv-cinder-816187-2-iscsi neutron-server[101244]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 16:12:45.535532 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device d14efac8-b33a-4eb0-b610-32a9bf41b972 up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:12:45.566595 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-868772', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-2032313'] for network, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:45.574509 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:45.577762 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] 10.222.0.37 "DELETE /v2.0/networks/8d351af8-ed05-48f5-939b-8cf227b5c91c HTTP/1.1" status: 204 len: 168 time: 0.5321362 Nov 08 16:12:45.587187 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning for port d14efac8-b33a-4eb0-b610-32a9bf41b972 completed by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 16:12:45.590126 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7be1eed-dcff-4781-8a8b-05c902c0179a admin admin] Pushing event deleted for resources: {'Network': ['ID=8d351af8-ed05-48f5-939b-8cf227b5c91c,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:45.591652 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port d14efac8-b33a-4eb0-b610-32a9bf41b972 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:12:45.592206 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:45.672468 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:45.696168 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '333fb179-0416-4534-95d0-4d9f3a9478f0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd14efac8-b33a-4eb0-b610-32a9bf41b972'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:12:45.698987 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-539b0dd6-4b3b-4964-ac28-8a67f9fb0e49" -d '{"events": [{"server_uuid": "333fb179-0416-4534-95d0-4d9f3a9478f0", "name": "network-vif-plugged", "status": "completed", "tag": "d14efac8-b33a-4eb0-b610-32a9bf41b972"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:12:45.712006 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port d14efac8-b33a-4eb0-b610-32a9bf41b972, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=d14efac8-b33a-4eb0-b610-32a9bf41b972,segment=NetworkSegment(fab7ad78-c438-48e7-8fdb-80ff50b8600c),segment_id=fab7ad78-c438-48e7-8fdb-80ff50b8600c)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:12:45.716490 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:45.717610 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 70c72d16-a0e9-49bb-b7b8-ef436d81a390 no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:12:45.749043 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 33666) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:45.752067 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] No Port match for: 70c72d16-a0e9-49bb-b7b8-ef436d81a390 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:12:45.752404 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 70c72d16-a0e9-49bb-b7b8-ef436d81a390 not bound to the agent host hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:12:45.774133 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:12:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fa00c635-a054-4fd0-9b42-24334417d351 x-openstack-request-id: req-fa00c635-a054-4fd0-9b42-24334417d351 {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:12:45.774422 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "333fb179-0416-4534-95d0-4d9f3a9478f0", "name": "network-vif-plugged", "status": "completed", "tag": "d14efac8-b33a-4eb0-b610-32a9bf41b972", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:12:45.774668 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-fa00c635-a054-4fd0-9b42-24334417d351 {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:12:45.775048 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '333fb179-0416-4534-95d0-4d9f3a9478f0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd14efac8-b33a-4eb0-b610-32a9bf41b972', 'code': 200} Nov 08 16:12:45.794796 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-fc6ad443-9ffd-47b3-893f-8b4b2b8ec5ff admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=170b9e4079834c589534d39e70e1dba3&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0443637 Nov 08 16:12:45.797243 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 33668) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:45.813870 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=d14efac8-b33a-4eb0-b610-32a9bf41b972,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:45.859206 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-239e3ebb-a914-4efd-9480-7e735f47e65b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:45.880791 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-239e3ebb-a914-4efd-9480-7e735f47e65b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:45.928141 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-239e3ebb-a914-4efd-9480-7e735f47e65b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:45.931369 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-239e3ebb-a914-4efd-9480-7e735f47e65b admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:45.932507 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-239e3ebb-a914-4efd-9480-7e735f47e65b admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/038cdbd7-8cb8-45e1-a69d-0ade6842560f HTTP/1.1" status: 204 len: 168 time: 0.1340573 Nov 08 16:12:45.940846 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-239e3ebb-a914-4efd-9480-7e735f47e65b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=038cdbd7-8cb8-45e1-a69d-0ade6842560f,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:46.048856 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b074faec-6e29-4051-9e67-cec1241495c2 req-b9b78908-085d-4348-bff0-3ea4e575bcde service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:46.050382 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b074faec-6e29-4051-9e67-cec1241495c2 req-b9b78908-085d-4348-bff0-3ea4e575bcde service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=333fb179-0416-4534-95d0-4d9f3a9478f0 HTTP/1.1" status: 200 len: 1098 time: 0.0900209 Nov 08 16:12:46.067136 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8be2bcbb-0347-4055-a718-f35e343426fd req-933bd896-2759-4ca0-92d2-b6a55ec39f62 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:46.068765 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8be2bcbb-0347-4055-a718-f35e343426fd req-933bd896-2759-4ca0-92d2-b6a55ec39f62 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=333fb179-0416-4534-95d0-4d9f3a9478f0 HTTP/1.1" status: 200 len: 945 time: 0.0650401 Nov 08 16:12:46.151703 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b074faec-6e29-4051-9e67-cec1241495c2 req-75d3f124-d5e1-414c-9a27-4dd3c3cfb54e service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0761070 Nov 08 16:12:46.155198 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8be2bcbb-0347-4055-a718-f35e343426fd req-a3bbd7e6-8322-4ce0-aecb-bd6682718eeb tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0782995 Nov 08 16:12:46.196306 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:46.272370 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c526675b-2753-447f-bbad-be5546606f14 req-ad3ff67b-21b9-4cec-b45e-1b43979f5cff tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:46.275123 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c526675b-2753-447f-bbad-be5546606f14 req-ad3ff67b-21b9-4cec-b45e-1b43979f5cff tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0499249 Nov 08 16:12:46.324434 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c526675b-2753-447f-bbad-be5546606f14 req-e893a9ff-569b-4d8b-91bf-7885dfb0b6f2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434699 Nov 08 16:12:47.379460 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0435e99-4e3f-4364-b6f0-8684fad68808 req-fb69df05-46b9-49c0-b780-0e76caa67f1a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:47.383550 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a0435e99-4e3f-4364-b6f0-8684fad68808 req-fb69df05-46b9-49c0-b780-0e76caa67f1a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=333fb179-0416-4534-95d0-4d9f3a9478f0 HTTP/1.1" status: 200 len: 945 time: 0.0554841 Nov 08 16:12:47.468961 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a0435e99-4e3f-4364-b6f0-8684fad68808 req-49db4aa1-a1c2-4dff-9d66-96d93fa5cafb tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0807712 Nov 08 16:12:47.482234 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27d9cfe2-fc9f-4340-a389-9cdb6647ff44 req-84425487-dc78-492b-b7d6-55a717ce3d2e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:47.483780 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-27d9cfe2-fc9f-4340-a389-9cdb6647ff44 req-84425487-dc78-492b-b7d6-55a717ce3d2e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0713856 Nov 08 16:12:47.531824 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-27d9cfe2-fc9f-4340-a389-9cdb6647ff44 req-10706b81-13aa-42e2-8d20-a1384fbfa736 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417008 Nov 08 16:12:47.723449 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 33752) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:47.844742 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-dc910d43-d5c2-4df4-871e-29f65265e303 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:47.921741 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-dc910d43-d5c2-4df4-871e-29f65265e303 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:47.925373 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-dc910d43-d5c2-4df4-871e-29f65265e303 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:47.963555 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-dc910d43-d5c2-4df4-871e-29f65265e303 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=0980a64cf600465cab4211c459347043&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2384851 Nov 08 16:12:47.965579 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc910d43-d5c2-4df4-871e-29f65265e303 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=faf404bf-a00c-480d-a2bf-7f7c0f30f462,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:47.966328 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 33760) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:48.013877 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9e4e49c8-8fb0-4cb8-b1d7-af10233596c8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:48.034748 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9e4e49c8-8fb0-4cb8-b1d7-af10233596c8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:48.088653 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9e4e49c8-8fb0-4cb8-b1d7-af10233596c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:48.091279 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9e4e49c8-8fb0-4cb8-b1d7-af10233596c8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:48.092406 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-9e4e49c8-8fb0-4cb8-b1d7-af10233596c8 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/faf404bf-a00c-480d-a2bf-7f7c0f30f462 HTTP/1.1" status: 204 len: 168 time: 0.1251168 Nov 08 16:12:48.102366 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e4e49c8-8fb0-4cb8-b1d7-af10233596c8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=faf404bf-a00c-480d-a2bf-7f7c0f30f462,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:48.379206 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 33772) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:48.392476 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-08e24d55-b903-4ed5-8990-3e82288075cf admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:48.469318 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-08e24d55-b903-4ed5-8990-3e82288075cf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:48.472874 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-08e24d55-b903-4ed5-8990-3e82288075cf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:48.511759 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-08e24d55-b903-4ed5-8990-3e82288075cf admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=cc62bb1df4044772bd7d15e957799586&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1314764 Nov 08 16:12:48.512608 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08e24d55-b903-4ed5-8990-3e82288075cf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=495cfbf0-9953-492b-a32c-32b24db7750b,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:48.515272 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 33776) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:48.571061 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-14d36cc2-74d7-4bec-9805-27fa9997273c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:48.592656 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-14d36cc2-74d7-4bec-9805-27fa9997273c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:48.594554 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a075eb10-1b86-4f5b-be5a-4b28ccce3546 req-7692b3bf-bbdd-470f-b494-669544e41f09 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:48.596515 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a075eb10-1b86-4f5b-be5a-4b28ccce3546 req-7692b3bf-bbdd-470f-b494-669544e41f09 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=333fb179-0416-4534-95d0-4d9f3a9478f0 HTTP/1.1" status: 200 len: 945 time: 0.0533965 Nov 08 16:12:48.640079 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-14d36cc2-74d7-4bec-9805-27fa9997273c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:48.642787 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-14d36cc2-74d7-4bec-9805-27fa9997273c admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:48.644028 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-14d36cc2-74d7-4bec-9805-27fa9997273c admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/495cfbf0-9953-492b-a32c-32b24db7750b HTTP/1.1" status: 204 len: 168 time: 0.1270678 Nov 08 16:12:48.652237 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14d36cc2-74d7-4bec-9805-27fa9997273c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=495cfbf0-9953-492b-a32c-32b24db7750b,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:48.678879 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a075eb10-1b86-4f5b-be5a-4b28ccce3546 req-f4857904-187f-4994-9208-d4eaf562c9f3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0753858 Nov 08 16:12:48.687802 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfa753e7-57a4-4c2e-b9c6-654cd19bc2c4 req-eebb04d4-2422-498f-93c3-10f22c4de7ed tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:48.689462 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cfa753e7-57a4-4c2e-b9c6-654cd19bc2c4 req-eebb04d4-2422-498f-93c3-10f22c4de7ed tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0799959 Nov 08 16:12:48.750223 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cfa753e7-57a4-4c2e-b9c6-654cd19bc2c4 req-a64c67a1-6e7b-4092-9681-4e16efb0c7b6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0548851 Nov 08 16:12:49.873539 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7707f74d-e050-4ae4-8d06-546841b8c65f req-f5190e94-98de-4881-9d62-de6490b14e74 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:49.875938 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7707f74d-e050-4ae4-8d06-546841b8c65f req-f5190e94-98de-4881-9d62-de6490b14e74 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0497844 Nov 08 16:12:49.928935 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7707f74d-e050-4ae4-8d06-546841b8c65f req-9af11c12-f2f1-4894-81df-73e359c51746 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437164 Nov 08 16:12:51.042909 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a13fbf6-6c5e-4434-95a8-cf63686bf2a1 req-27ccc385-ef9e-454e-b985-7fb0da9ee60b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:51.044472 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5a13fbf6-6c5e-4434-95a8-cf63686bf2a1 req-27ccc385-ef9e-454e-b985-7fb0da9ee60b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0474200 Nov 08 16:12:51.094494 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5a13fbf6-6c5e-4434-95a8-cf63686bf2a1 req-dc4654a5-eec9-47f4-8b21-4655a0810d66 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442533 Nov 08 16:12:51.706387 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-3f372f9b-64c0-4f27-8962-99f200b3db51 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:51.707845 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-3f372f9b-64c0-4f27-8962-99f200b3db51 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/networks?id=f70ee550-62a6-48db-bca5-a0b964bbcce9 HTTP/1.1" status: 200 len: 815 time: 0.0996249 Nov 08 16:12:51.723356 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-65d5fe80-6764-4e93-9de5-63aeb5971bbd tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/quotas/549e9715f7424ff5b3b252f354adafe9 HTTP/1.1" status: 200 len: 375 time: 0.0092652 Nov 08 16:12:51.774585 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-06311786-9808-47e6-8efe-3704c0ef4e7e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?tenant_id=549e9715f7424ff5b3b252f354adafe9&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0457568 Nov 08 16:12:51.866453 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-f0c39b50-dfff-4997-89b4-e8b54d35c06a service neutron] 10.222.0.37 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0849099 Nov 08 16:12:51.954609 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-1624814e-2f3a-4db4-a6a1-92460d707c8e service neutron] 10.222.0.37 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0811276 Nov 08 16:12:52.155077 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-810dce65-00d0-43c6-aff5-e9d62eebf143 req-ae24e2af-726b-46d8-9f95-fbb37d5a5e53 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=1400ac35-c2ae-4814-ac9b-d18094175dce HTTP/1.1" status: 200 len: 210 time: 0.0450406 Nov 08 16:12:52.229101 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8118862c-135a-4851-b291-0de4101f6ed5 req-e9a20156-c2b6-44db-9b7b-990d3c8ef90c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:52.230934 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8118862c-135a-4851-b291-0de4101f6ed5 req-e9a20156-c2b6-44db-9b7b-990d3c8ef90c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0502906 Nov 08 16:12:52.282331 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8118862c-135a-4851-b291-0de4101f6ed5 req-846ba25b-8550-4558-937d-4f4619090a84 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438905 Nov 08 16:12:53.250822 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c62b46cd-d8ac-420b-b111-20dd30bdaf58 req-620bf37c-5343-4e1c-a823-db41010ce551 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=1400ac35-c2ae-4814-ac9b-d18094175dce HTTP/1.1" status: 200 len: 210 time: 0.0266516 Nov 08 16:12:53.406513 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8517ffb-c5ff-40a3-92b6-61f6d2c1b756 req-595f1f6a-a212-4c4f-9a54-78a47de24d3c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:53.408321 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b8517ffb-c5ff-40a3-92b6-61f6d2c1b756 req-595f1f6a-a212-4c4f-9a54-78a47de24d3c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0526166 Nov 08 16:12:53.481060 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b8517ffb-c5ff-40a3-92b6-61f6d2c1b756 req-bec5c88c-3a5e-47f2-9ffe-9bb3952f45c4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0656402 Nov 08 16:12:53.564715 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-8a67afed-dce1-4945-ad8d-36bf601e51d8 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:53.566243 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-8a67afed-dce1-4945-ad8d-36bf601e51d8 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.25 "GET /v2.0/networks?id=f70ee550-62a6-48db-bca5-a0b964bbcce9 HTTP/1.1" status: 200 len: 815 time: 0.1144011 Nov 08 16:12:53.584633 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-807bbfe9-1886-4054-962a-372c25b0fc85 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Request body: {'port': {'device_id': '1400ac35-c2ae-4814-ac9b-d18094175dce', 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9', 'admin_state_up': True, 'tenant_id': '549e9715f7424ff5b3b252f354adafe9'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:12:53.692918 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-807bbfe9-1886-4054-962a-372c25b0fc85 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Made reservation on behalf of 549e9715f7424ff5b3b252f354adafe9 for: {'port': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:12:53.696944 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-807bbfe9-1886-4054-962a-372c25b0fc85 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:53.829079 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-807bbfe9-1886-4054-962a-372c25b0fc85 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Allocated IP 172.20.0.6 (f70ee550-62a6-48db-bca5-a0b964bbcce9/cd23e532-b366-42a0-82e4-ec7326cf3b48/b2d31fb8-0a87-4aea-8200-914cd468d395) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:12:53.972765 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-807bbfe9-1886-4054-962a-372c25b0fc85 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:54.008886 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-807bbfe9-1886-4054-962a-372c25b0fc85 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:54.022807 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['4020a644-ef2e-4dd8-931a-cfccef4e7b15', 'd14efac8-b33a-4eb0-b610-32a9bf41b972'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:12:54.050943 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-807bbfe9-1886-4054-962a-372c25b0fc85 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Network f70ee550-62a6-48db-bca5-a0b964bbcce9 is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:12:54.056477 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-807bbfe9-1886-4054-962a-372c25b0fc85 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:12:54.060452 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-807bbfe9-1886-4054-962a-372c25b0fc85 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:12:54.090732 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-807bbfe9-1886-4054-962a-372c25b0fc85 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Pushing event updated for resources: {'Port': ['ID=b2d31fb8-0a87-4aea-8200-914cd468d395,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:54.122416 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-807bbfe9-1886-4054-962a-372c25b0fc85 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:54.123456 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-807bbfe9-1886-4054-962a-372c25b0fc85 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:54.146413 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-807bbfe9-1886-4054-962a-372c25b0fc85 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5654874 Nov 08 16:12:54.170295 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-1260595e-a397-4902-9467-7ed0671ef512 service neutron] Request body: {'port': {'device_id': '1400ac35-c2ae-4814-ac9b-d18094175dce', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81618'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:12:54.348497 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4063e35d-74c5-4b75-bd11-0215066202ae req-d06775f8-a537-489c-a388-5f7f870c972a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:54.351018 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-4063e35d-74c5-4b75-bd11-0215066202ae req-d06775f8-a537-489c-a388-5f7f870c972a service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 1099 time: 0.0485384 Nov 08 16:12:54.408439 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-4063e35d-74c5-4b75-bd11-0215066202ae req-446e0cb2-835b-41d6-a25e-0ccb267d43ee service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449569 Nov 08 16:12:54.488306 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-1260595e-a397-4902-9467-7ed0671ef512 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:54.511880 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e5ae299-224d-40a6-b954-aa498fb32036 req-44add932-6180-4a91-a3fb-38736139346e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:54.513368 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0e5ae299-224d-40a6-b954-aa498fb32036 req-44add932-6180-4a91-a3fb-38736139346e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=1400ac35-c2ae-4814-ac9b-d18094175dce HTTP/1.1" status: 200 len: 931 time: 0.0839143 Nov 08 16:12:54.688278 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0e5ae299-224d-40a6-b954-aa498fb32036 req-9a5c558b-41cc-48d3-a666-2dcf9d605c52 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1509435 Nov 08 16:12:54.744016 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e387ba09-b2db-4b7b-b35b-2eb4595d808a req-9ab9a7d5-e572-4d48-a602-3df68f762b52 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:54.745494 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e387ba09-b2db-4b7b-b35b-2eb4595d808a req-9ab9a7d5-e572-4d48-a602-3df68f762b52 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.1888494 Nov 08 16:12:54.825835 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e387ba09-b2db-4b7b-b35b-2eb4595d808a req-fccfbb50-ad04-404a-8914-3a8aa5225713 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0728741 Nov 08 16:12:54.895927 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-1260595e-a397-4902-9467-7ed0671ef512 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b2d31fb8-0a87-4aea-8200-914cd468d395 {{(pid=101244) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:12:54.903701 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-1260595e-a397-4902-9467-7ed0671ef512 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:54.916781 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.provisioning_blocks [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-1260595e-a397-4902-9467-7ed0671ef512 service neutron] Transition to ACTIVE for port object b2d31fb8-0a87-4aea-8200-914cd468d395 will not be triggered until provisioned by entity L2. {{(pid=101244) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 16:12:54.920250 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-1260595e-a397-4902-9467-7ed0671ef512 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:54.968276 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1260595e-a397-4902-9467-7ed0671ef512 service neutron] Pushing event updated for resources: {'Port': ['ID=b2d31fb8-0a87-4aea-8200-914cd468d395,revision_number=2']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:55.045268 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-1260595e-a397-4902-9467-7ed0671ef512 service neutron] Attempting to bind port b2d31fb8-0a87-4aea-8200-914cd468d395 on host hv-cinder-81618 for vnic_type normal with profile {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:12:55.045268 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-1260595e-a397-4902-9467-7ed0671ef512 service neutron] Attempting to bind port b2d31fb8-0a87-4aea-8200-914cd468d395 by drivers openvswitch,hyperv on host hv-cinder-81618 at level 0 using segments [{'id': 'fab7ad78-c438-48e7-8fdb-80ff50b8600c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9'}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:12:55.045268 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-1260595e-a397-4902-9467-7ed0671ef512 service neutron] Attempting to bind port b2d31fb8-0a87-4aea-8200-914cd468d395 on network f70ee550-62a6-48db-bca5-a0b964bbcce9 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:12:55.049112 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-1260595e-a397-4902-9467-7ed0671ef512 service neutron] Port b2d31fb8-0a87-4aea-8200-914cd468d395 on network f70ee550-62a6-48db-bca5-a0b964bbcce9 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81618 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 16:12:55.049455 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-1260595e-a397-4902-9467-7ed0671ef512 service neutron] Attempting to bind port b2d31fb8-0a87-4aea-8200-914cd468d395 on network f70ee550-62a6-48db-bca5-a0b964bbcce9 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:12:55.055059 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-1260595e-a397-4902-9467-7ed0671ef512 service neutron] Checking agent: {'id': '54bf9779-c14d-412a-90fc-96b4a6589d5a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81618', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'started_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 12, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:12:55.055386 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-1260595e-a397-4902-9467-7ed0671ef512 service neutron] Checking segment: {'id': 'fab7ad78-c438-48e7-8fdb-80ff50b8600c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:12:55.055767 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-1260595e-a397-4902-9467-7ed0671ef512 service neutron] Bound using segment: {'id': 'fab7ad78-c438-48e7-8fdb-80ff50b8600c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9'} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:12:55.056213 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-1260595e-a397-4902-9467-7ed0671ef512 service neutron] Bound port: b2d31fb8-0a87-4aea-8200-914cd468d395, host: hv-cinder-81618, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fab7ad78-c438-48e7-8fdb-80ff50b8600c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9'}}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:12:55.056569 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-1260595e-a397-4902-9467-7ed0671ef512 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:55.123989 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-1260595e-a397-4902-9467-7ed0671ef512 service neutron] For port b2d31fb8-0a87-4aea-8200-914cd468d395, host hv-cinder-81618, cleared binding levels {{(pid=101244) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:12:55.127420 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-1260595e-a397-4902-9467-7ed0671ef512 service neutron] For port b2d31fb8-0a87-4aea-8200-914cd468d395, host hv-cinder-81618, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=b2d31fb8-0a87-4aea-8200-914cd468d395,segment=NetworkSegment(fab7ad78-c438-48e7-8fdb-80ff50b8600c),segment_id=fab7ad78-c438-48e7-8fdb-80ff50b8600c)] {{(pid=101244) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:12:55.133359 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-1260595e-a397-4902-9467-7ed0671ef512 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:55.175921 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-1260595e-a397-4902-9467-7ed0671ef512 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:55.176771 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-1260595e-a397-4902-9467-7ed0671ef512 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:55.177987 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-1260595e-a397-4902-9467-7ed0671ef512 service neutron] 10.222.0.25 "PUT /v2.0/ports/b2d31fb8-0a87-4aea-8200-914cd468d395 HTTP/1.1" status: 200 len: 1093 time: 1.0121858 Nov 08 16:12:55.178420 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1400ac35-c2ae-4814-ac9b-d18094175dce', 'tag': 'b2d31fb8-0a87-4aea-8200-914cd468d395'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:12:55.181017 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-77640e91-b400-4cf3-9d57-879a1034edad" -d '{"events": [{"name": "network-changed", "server_uuid": "1400ac35-c2ae-4814-ac9b-d18094175dce", "tag": "b2d31fb8-0a87-4aea-8200-914cd468d395"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:12:55.203633 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1260595e-a397-4902-9467-7ed0671ef512 service neutron] Pushing event updated for resources: {'Port': ['ID=b2d31fb8-0a87-4aea-8200-914cd468d395,revision_number=3']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:55.223169 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:12:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c54aeaa9-5106-4ac1-9178-7d79c2cdc377 x-openstack-request-id: req-c54aeaa9-5106-4ac1-9178-7d79c2cdc377 {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:12:55.223581 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1400ac35-c2ae-4814-ac9b-d18094175dce", "tag": "b2d31fb8-0a87-4aea-8200-914cd468d395", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:12:55.223834 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-c54aeaa9-5106-4ac1-9178-7d79c2cdc377 {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:12:55.224229 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1400ac35-c2ae-4814-ac9b-d18094175dce', 'tag': 'b2d31fb8-0a87-4aea-8200-914cd468d395', 'status': 'completed', 'code': 200} Nov 08 16:12:55.242660 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 34020) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:55.300156 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-b4525a8f-f043-4a52-91e0-7fd39c67a9c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:55.301646 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-b4525a8f-f043-4a52-91e0-7fd39c67a9c2 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=549e9715f7424ff5b3b252f354adafe9&device_id=1400ac35-c2ae-4814-ac9b-d18094175dce HTTP/1.1" status: 200 len: 1096 time: 0.0413551 Nov 08 16:12:55.356891 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-faa3c403-1b64-4b31-b71c-54a5106d4a56 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=b2d31fb8-0a87-4aea-8200-914cd468d395 HTTP/1.1" status: 200 len: 217 time: 0.0417783 Nov 08 16:12:55.363674 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-dfc276e2-5a12-44e6-8593-2151226c7443 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:55.434909 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-48dd86f4-4170-4830-9e7b-0a40b88394b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:55.436243 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-48dd86f4-4170-4830-9e7b-0a40b88394b8 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=cd23e532-b366-42a0-82e4-ec7326cf3b48 HTTP/1.1" status: 200 len: 855 time: 0.0611968 Nov 08 16:12:55.474468 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-169fae15-705c-45d8-8e66-81d22d8974aa service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=f70ee550-62a6-48db-bca5-a0b964bbcce9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0280011 Nov 08 16:12:55.543302 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-dfc276e2-5a12-44e6-8593-2151226c7443 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:55.547464 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-dfc276e2-5a12-44e6-8593-2151226c7443 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:55.598027 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-dfc276e2-5a12-44e6-8593-2151226c7443 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=036c9621556a4833ba1158e45fa8289c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3542998 Nov 08 16:12:55.600805 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 34028) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:55.610008 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfc276e2-5a12-44e6-8593-2151226c7443 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e23e55be-907e-4a3b-9bce-f8dbaa0125d2,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:55.634967 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-3b2d857e-c22d-4680-8f70-14e1ed3e4495 service neutron] 10.222.0.25 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1458113 Nov 08 16:12:55.716678 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-99d82deb-66ff-498c-9433-55d29605c65b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:55.759689 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-99d82deb-66ff-498c-9433-55d29605c65b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:55.774484 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-17435346-b4f1-4355-bc6a-e0a31c0d11fc req-7cdd61e4-0660-42d9-b018-9daf870c6189 service neutron] 10.222.0.25 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1291833 Nov 08 16:12:55.838261 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-99d82deb-66ff-498c-9433-55d29605c65b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:55.840763 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-99d82deb-66ff-498c-9433-55d29605c65b admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:55.841914 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-99d82deb-66ff-498c-9433-55d29605c65b admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/e23e55be-907e-4a3b-9bce-f8dbaa0125d2 HTTP/1.1" status: 204 len: 168 time: 0.2386281 Nov 08 16:12:55.856063 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-249fe8ab-ee33-4ea5-9c32-1de44267e817 req-af02b227-678f-4947-829c-8d5d372fd5d9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:55.862253 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-249fe8ab-ee33-4ea5-9c32-1de44267e817 req-af02b227-678f-4947-829c-8d5d372fd5d9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=1400ac35-c2ae-4814-ac9b-d18094175dce HTTP/1.1" status: 200 len: 943 time: 0.0678725 Nov 08 16:12:55.887178 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99d82deb-66ff-498c-9433-55d29605c65b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e23e55be-907e-4a3b-9bce-f8dbaa0125d2,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:55.960234 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-249fe8ab-ee33-4ea5-9c32-1de44267e817 req-4c1304fd-aef5-40b4-b493-1caf864644a7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0969095 Nov 08 16:12:55.963060 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77640e91-b400-4cf3-9d57-879a1034edad req-4ca154c9-6d11-4f65-9cd4-dcbc6a6dcea4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:55.964508 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-77640e91-b400-4cf3-9d57-879a1034edad req-4ca154c9-6d11-4f65-9cd4-dcbc6a6dcea4 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=549e9715f7424ff5b3b252f354adafe9&device_id=1400ac35-c2ae-4814-ac9b-d18094175dce HTTP/1.1" status: 200 len: 1096 time: 0.0869555 Nov 08 16:12:56.072394 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27b4cb36-762e-48b7-8b58-3ca230f7930b req-219cdec7-c424-4637-b1fd-a5938ddadbc5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:56.073917 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-27b4cb36-762e-48b7-8b58-3ca230f7930b req-219cdec7-c424-4637-b1fd-a5938ddadbc5 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.1061125 Nov 08 16:12:56.131380 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77640e91-b400-4cf3-9d57-879a1034edad req-4ddbe392-220e-499c-baed-a9c562ec5799 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:56.132879 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-77640e91-b400-4cf3-9d57-879a1034edad req-4ddbe392-220e-499c-baed-a9c562ec5799 service neutron] 10.222.0.25 "GET /v2.0/networks?id=f70ee550-62a6-48db-bca5-a0b964bbcce9 HTTP/1.1" status: 200 len: 916 time: 0.1499050 Nov 08 16:12:56.144866 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-27b4cb36-762e-48b7-8b58-3ca230f7930b req-0bcf0df7-f991-4d1c-bd06-abb2fec26b51 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0623066 Nov 08 16:12:56.191833 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-77640e91-b400-4cf3-9d57-879a1034edad req-5e3b4cd5-b038-4a89-8d04-4a6e54b0c573 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=b2d31fb8-0a87-4aea-8200-914cd468d395 HTTP/1.1" status: 200 len: 217 time: 0.0383282 Nov 08 16:12:56.204150 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 34050) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:56.220655 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-38de717e-be48-4e1e-b8a5-4c57015cd697 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:56.243253 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77640e91-b400-4cf3-9d57-879a1034edad req-bccab6a1-0e55-4d63-8e20-7a33208168ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:56.244735 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-77640e91-b400-4cf3-9d57-879a1034edad req-bccab6a1-0e55-4d63-8e20-7a33208168ad service neutron] 10.222.0.25 "GET /v2.0/subnets?id=cd23e532-b366-42a0-82e4-ec7326cf3b48 HTTP/1.1" status: 200 len: 855 time: 0.0449378 Nov 08 16:12:56.286934 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-77640e91-b400-4cf3-9d57-879a1034edad req-e5b0229b-8bc0-4f41-b41d-b6b5621f7fa5 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=f70ee550-62a6-48db-bca5-a0b964bbcce9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0331855 Nov 08 16:12:56.329584 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-38de717e-be48-4e1e-b8a5-4c57015cd697 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:56.334218 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-38de717e-be48-4e1e-b8a5-4c57015cd697 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:56.383474 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-38de717e-be48-4e1e-b8a5-4c57015cd697 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=c06de12514bd447fafe1382be0790b7f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1779478 Nov 08 16:12:56.384326 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38de717e-be48-4e1e-b8a5-4c57015cd697 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2e8b62a7-4e5e-4f68-8b71-7a092956ee95,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:56.386048 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 34058) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:56.462810 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-77640e91-b400-4cf3-9d57-879a1034edad req-a0fca59b-4453-4871-afb1-01ca80424ed4 service neutron] 10.222.0.25 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1522861 Nov 08 16:12:56.496265 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b9f57b6c-e051-4368-b196-cb625eca875b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:56.557353 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b9f57b6c-e051-4368-b196-cb625eca875b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:56.610518 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-77640e91-b400-4cf3-9d57-879a1034edad req-69d6111f-d2b6-4e00-a6b1-eba81f507814 service neutron] 10.222.0.25 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1426539 Nov 08 16:12:56.629859 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b9f57b6c-e051-4368-b196-cb625eca875b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:56.633450 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b9f57b6c-e051-4368-b196-cb625eca875b admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:56.634630 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-b9f57b6c-e051-4368-b196-cb625eca875b admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/2e8b62a7-4e5e-4f68-8b71-7a092956ee95 HTTP/1.1" status: 204 len: 168 time: 0.2455182 Nov 08 16:12:56.642246 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9f57b6c-e051-4368-b196-cb625eca875b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2e8b62a7-4e5e-4f68-8b71-7a092956ee95,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:57.090466 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14fb410e-bb9f-4cd5-bf28-789d374205e4 req-b7b0c351-f8a6-483f-a308-4a6aa1b15497 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:57.092203 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-14fb410e-bb9f-4cd5-bf28-789d374205e4 req-b7b0c351-f8a6-483f-a308-4a6aa1b15497 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=1400ac35-c2ae-4814-ac9b-d18094175dce HTTP/1.1" status: 200 len: 943 time: 0.0535164 Nov 08 16:12:57.146318 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-14fb410e-bb9f-4cd5-bf28-789d374205e4 req-a9068a4e-14a4-4062-89a0-82d2725d3b36 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479777 Nov 08 16:12:57.273134 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83ea161f-49d4-4108-a523-1d12dbadcf33 req-0122fee8-8200-4bfa-9c78-8b7d79be88fb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:57.274562 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-83ea161f-49d4-4108-a523-1d12dbadcf33 req-0122fee8-8200-4bfa-9c78-8b7d79be88fb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0534742 Nov 08 16:12:57.321079 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-83ea161f-49d4-4108-a523-1d12dbadcf33 req-6c7cdbe6-af59-4687-887b-850304b83722 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402355 Nov 08 16:12:57.434652 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b85099e2-ea1a-437b-8b85-9b815af4d827 req-48dd2339-b682-4b2b-a3f3-f14a965861cb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:57.436295 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b85099e2-ea1a-437b-8b85-9b815af4d827 req-48dd2339-b682-4b2b-a3f3-f14a965861cb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0496471 Nov 08 16:12:57.494556 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b85099e2-ea1a-437b-8b85-9b815af4d827 req-02bbf787-8c8a-47ea-8029-973cb425c562 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517101 Nov 08 16:12:58.281298 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42c2d905-0f58-4fed-bffa-b9e87f3504b4 req-c3d29896-aad4-4b3f-aca4-c4b5478b7c13 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:58.282825 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-42c2d905-0f58-4fed-bffa-b9e87f3504b4 req-c3d29896-aad4-4b3f-aca4-c4b5478b7c13 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=1400ac35-c2ae-4814-ac9b-d18094175dce HTTP/1.1" status: 200 len: 943 time: 0.0607362 Nov 08 16:12:58.331431 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-42c2d905-0f58-4fed-bffa-b9e87f3504b4 req-e8fcfaf6-7fe0-42bb-8f3a-a9e124dce2a0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415349 Nov 08 16:12:58.761447 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 34188) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:58.878841 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d476248f-32a7-4eab-ac19-950f38c70fd6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:58.953846 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d476248f-32a7-4eab-ac19-950f38c70fd6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:58.957620 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d476248f-32a7-4eab-ac19-950f38c70fd6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:58.997411 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-d476248f-32a7-4eab-ac19-950f38c70fd6 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=2cb1c81cd87e4cc28e444acc075c3edc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2347722 Nov 08 16:12:58.998662 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d476248f-32a7-4eab-ac19-950f38c70fd6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c124c06d-16ba-4160-a8ff-446ad668ef3c,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:58.999508 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 34204) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:59.053587 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-05d0bdb8-fa5b-49aa-8703-5ca682dbd2d4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:59.080275 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-05d0bdb8-fa5b-49aa-8703-5ca682dbd2d4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:59.126760 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-05d0bdb8-fa5b-49aa-8703-5ca682dbd2d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:59.129565 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-05d0bdb8-fa5b-49aa-8703-5ca682dbd2d4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:59.130716 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-05d0bdb8-fa5b-49aa-8703-5ca682dbd2d4 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/c124c06d-16ba-4160-a8ff-446ad668ef3c HTTP/1.1" status: 204 len: 168 time: 0.1300733 Nov 08 16:12:59.139859 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05d0bdb8-fa5b-49aa-8703-5ca682dbd2d4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c124c06d-16ba-4160-a8ff-446ad668ef3c,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:59.400178 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 34222) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:59.415983 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-2c2e880c-2006-42b0-af3a-013ef23041f4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:59.449822 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-075d6d45-aba5-4add-bd33-afcb881e740e req-8fd7af6f-5394-46bc-9c0d-0ede7815b09d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:12:59.451319 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-075d6d45-aba5-4add-bd33-afcb881e740e req-8fd7af6f-5394-46bc-9c0d-0ede7815b09d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=1400ac35-c2ae-4814-ac9b-d18094175dce HTTP/1.1" status: 200 len: 943 time: 0.0488210 Nov 08 16:12:59.489164 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-2c2e880c-2006-42b0-af3a-013ef23041f4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:59.493499 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-2c2e880c-2006-42b0-af3a-013ef23041f4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:59.503321 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-075d6d45-aba5-4add-bd33-afcb881e740e req-f1f26693-0226-44a8-952a-e58cda2a14bd tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455108 Nov 08 16:12:59.531420 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-2c2e880c-2006-42b0-af3a-013ef23041f4 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=4f39940adefd4995af61bfbda5279a4a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1301122 Nov 08 16:12:59.532351 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c2e880c-2006-42b0-af3a-013ef23041f4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=521fef46-e921-4f61-8f45-abc6b0e640fe,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:59.534012 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 34224) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:12:59.581391 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5dadeb02-ae90-451a-8706-35447c54a820 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:59.601852 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5dadeb02-ae90-451a-8706-35447c54a820 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:59.617137 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device b2d31fb8-0a87-4aea-8200-914cd468d395 details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:12:59.648233 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5dadeb02-ae90-451a-8706-35447c54a820 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:59.651551 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5dadeb02-ae90-451a-8706-35447c54a820 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:59.652884 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-5dadeb02-ae90-451a-8706-35447c54a820 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/521fef46-e921-4f61-8f45-abc6b0e640fe HTTP/1.1" status: 204 len: 168 time: 0.1177409 Nov 08 16:12:59.665059 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dadeb02-ae90-451a-8706-35447c54a820 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=521fef46-e921-4f61-8f45-abc6b0e640fe,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:12:59.753256 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port b2d31fb8-0a87-4aea-8200-914cd468d395, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=b2d31fb8-0a87-4aea-8200-914cd468d395,segment=NetworkSegment(fab7ad78-c438-48e7-8fdb-80ff50b8600c),segment_id=fab7ad78-c438-48e7-8fdb-80ff50b8600c)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:12:59.764560 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': 'b2d31fb8-0a87-4aea-8200-914cd468d395', 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9', 'port_id': 'b2d31fb8-0a87-4aea-8200-914cd468d395', 'mac_address': 'fa:16:3e:fd:92:6f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 173, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cd23e532-b366-42a0-82e4-ec7326cf3b48', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:12:59.801587 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:59.814319 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b2d31fb8-0a87-4aea-8200-914cd468d395 {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:12:59.835116 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port b2d31fb8-0a87-4aea-8200-914cd468d395, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=b2d31fb8-0a87-4aea-8200-914cd468d395,segment=NetworkSegment(fab7ad78-c438-48e7-8fdb-80ff50b8600c),segment_id=fab7ad78-c438-48e7-8fdb-80ff50b8600c)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:12:59.839358 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:12:59.892294 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=b2d31fb8-0a87-4aea-8200-914cd468d395,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:00.183234 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8201b101-afbc-4804-920c-08ffb7fe4248 req-91860709-7b61-4134-b95d-df9fc0a5ab3c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:00.185168 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8201b101-afbc-4804-920c-08ffb7fe4248 req-91860709-7b61-4134-b95d-df9fc0a5ab3c service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=4818358a827143eb9ace58a26713cdf0&device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 1098 time: 0.0839674 Nov 08 16:13:00.211711 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 34262) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:13:00.213580 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb57fe96-f240-43be-b3c3-20c34a6ce84b req-6ee06411-4402-4def-a3c1-c4cd3ec611fa tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:00.215480 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cb57fe96-f240-43be-b3c3-20c34a6ce84b req-6ee06411-4402-4def-a3c1-c4cd3ec611fa tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0861588 Nov 08 16:13:00.261896 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_v2 [None req-a188e70e-779e-4c20-953f-cd3d55db0376 admin admin] Deleting subnet 463f37da-cc38-415e-8630-f7fdc5741a9c {{(pid=101245) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 16:13:00.266021 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a188e70e-779e-4c20-953f-cd3d55db0376 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:00.304930 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a188e70e-779e-4c20-953f-cd3d55db0376 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:00.310836 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a188e70e-779e-4c20-953f-cd3d55db0376 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-872226'] for subnet, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:00.314074 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cb57fe96-f240-43be-b3c3-20c34a6ce84b req-f3cdfc80-9365-451c-8fa9-e5e3e7d4ccd6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0882404 Nov 08 16:13:00.342069 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8201b101-afbc-4804-920c-08ffb7fe4248 req-a427ef05-d9a6-4435-b3b0-8ea890d03fb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:00.342069 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8201b101-afbc-4804-920c-08ffb7fe4248 req-a427ef05-d9a6-4435-b3b0-8ea890d03fb5 service neutron] 10.222.0.25 "GET /v2.0/networks?id=2d5b5768-37f3-49a1-b451-2803f6f97429 HTTP/1.1" status: 200 len: 919 time: 0.1410933 Nov 08 16:13:00.392501 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a188e70e-779e-4c20-953f-cd3d55db0376 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-872235', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for subnet, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:00.399147 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['b2d31fb8-0a87-4aea-8200-914cd468d395'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:13:00.411757 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8201b101-afbc-4804-920c-08ffb7fe4248 req-0231bf41-64ad-4faa-a2e1-df2a9b3beb7f service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=17db566c-bf28-4091-b7f6-4ffa5f80c982 HTTP/1.1" status: 200 len: 217 time: 0.0644467 Nov 08 16:13:00.431188 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a188e70e-779e-4c20-953f-cd3d55db0376 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=463f37da-cc38-415e-8630-f7fdc5741a9c,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:00.433225 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a188e70e-779e-4c20-953f-cd3d55db0376 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:00.439832 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-a188e70e-779e-4c20-953f-cd3d55db0376 admin admin] 10.222.0.37 "DELETE /v2.0/subnets/463f37da-cc38-415e-8630-f7fdc5741a9c HTTP/1.1" status: 204 len: 168 time: 0.2259262 Nov 08 16:13:00.440316 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 34274) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:13:00.498500 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8201b101-afbc-4804-920c-08ffb7fe4248 req-fe34320f-7c0a-419a-88e9-72942a5f4dfd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:00.501454 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8201b101-afbc-4804-920c-08ffb7fe4248 req-fe34320f-7c0a-419a-88e9-72942a5f4dfd service neutron] 10.222.0.25 "GET /v2.0/subnets?id=6936707c-bd3f-4cd8-9462-a4af0ea16ed8 HTTP/1.1" status: 200 len: 858 time: 0.0756564 Nov 08 16:13:00.515502 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1007047'] for network, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:00.569211 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8201b101-afbc-4804-920c-08ffb7fe4248 req-e54510b7-880f-46e8-990f-7dd70d867bbb service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=2d5b5768-37f3-49a1-b451-2803f6f97429&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0597596 Nov 08 16:13:00.612902 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-869719', 'neutron.services.segments.db._delete_segments_for_network-8792877333297'] for network, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:00.635300 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=101245) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:13:00.635634 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=101245) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:13:00.636476 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=101245) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:13:00.636794 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] Subscribe: > port after_create 55550000 {{(pid=101245) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:13:00.637111 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] Subscribe: > port after_delete 55550000 {{(pid=101245) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:13:00.637440 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] Subscribe: > port after_update 55550000 {{(pid=101245) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:13:00.637961 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=101245) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:13:00.638178 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=101245) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:13:00.638488 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=101245) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:13:00.638837 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=101245) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:13:00.710545 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=101245) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:13:00.710891 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=101245) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:13:00.711203 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=101245) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:13:00.711525 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=101245) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 16:13:00.711891 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.services.segments.db [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cc2fa33b-1a9d-4b06-98c2-93d61ec5eaa2']}} {{(pid=101245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:13:00.713278 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b31527b-d54c-4a0d-a935-295c9cd98068 req-d7f06e2e-609c-40f9-af6e-59451a889301 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:00.714856 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2b31527b-d54c-4a0d-a935-295c9cd98068 req-d7f06e2e-609c-40f9-af6e-59451a889301 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=1400ac35-c2ae-4814-ac9b-d18094175dce HTTP/1.1" status: 200 len: 944 time: 0.0797646 Nov 08 16:13:00.721588 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8201b101-afbc-4804-920c-08ffb7fe4248 req-83d8dad8-2ca4-47b3-8d87-f894cf4433c6 service neutron] 10.222.0.25 "GET /v2.0/networks/2d5b5768-37f3-49a1-b451-2803f6f97429?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1405935 Nov 08 16:13:00.729645 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.services.segments.db [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4508d137-3b5d-45fa-8b97-925e50ef424d') {'for_net_delete': True} {{(pid=101245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:13:00.729985 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.services.segments.db [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4508d137-3b5d-45fa-8b97-925e50ef424d') {} {{(pid=101245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:13:00.748612 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792877333818', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5113626'] for segment, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:00.761411 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 34286) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:13:00.789388 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:00.798519 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] Releasing vlan 181 on physical network physnet1 to pool {{(pid=101245) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 16:13:00.798979 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7464060'] for segment, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: from cryptography.utils import int_from_bytes Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: from cryptography.utils import int_from_bytes Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: Traceback (most recent call last): Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: timer() Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: cb(*args, **kw) Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: return func(*args, **kwargs) Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: self._notify() Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: self.callback(batched_events) Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: event.method(event) Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: return f(self, *a, **k) Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: return self._get(url).json() Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: return self.request(url, 'GET', **kwargs) Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 16:13:00.803367 dv-cinder-816187-2-iscsi neutron-server[101245]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 16:13:00.812124 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2b31527b-d54c-4a0d-a935-295c9cd98068 req-d6f8035a-ac55-4af6-b7b7-58238deab80e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0892851 Nov 08 16:13:00.877453 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-868772', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-2032313'] for network, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:00.887387 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:00.895324 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] 10.222.0.37 "DELETE /v2.0/networks/cc2fa33b-1a9d-4b06-98c2-93d61ec5eaa2 HTTP/1.1" status: 204 len: 168 time: 0.4501009 Nov 08 16:13:00.895707 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8201b101-afbc-4804-920c-08ffb7fe4248 req-a1b7a0ae-3d0d-4b7d-8c64-277f2c1193c8 service neutron] 10.222.0.25 "GET /v2.0/networks/2d5b5768-37f3-49a1-b451-2803f6f97429?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1569116 Nov 08 16:13:00.899741 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 34292) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:13:00.910296 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b7fcad5-99f5-42fe-ac34-c5e2aba03d07 admin admin] Pushing event deleted for resources: {'Network': ['ID=cc2fa33b-1a9d-4b06-98c2-93d61ec5eaa2,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:00.952615 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ebe2d7fd-7607-45f1-859f-708b4e1e254c admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:00.961125 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_v2 [None req-3bf2708f-b476-47ba-b808-b47fcecfa00b admin admin] Deleting subnet a4ec70e4-58ed-4fe0-83d4-9b640ac7073b {{(pid=101244) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 16:13:00.966153 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-3bf2708f-b476-47ba-b808-b47fcecfa00b admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.024036 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-3bf2708f-b476-47ba-b808-b47fcecfa00b admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8047127'] for subnet, precommit_delete_associations {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.036626 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ebe2d7fd-7607-45f1-859f-708b4e1e254c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.040915 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ebe2d7fd-7607-45f1-859f-708b4e1e254c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.074773 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-3bf2708f-b476-47ba-b808-b47fcecfa00b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-872226'] for subnet, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.086158 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-ebe2d7fd-7607-45f1-859f-708b4e1e254c admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=10e7cf9d94bf467d8f81df676602b49e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3234921 Nov 08 16:13:01.087141 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebe2d7fd-7607-45f1-859f-708b4e1e254c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dcdcebf0-159f-4e13-880a-87b6d2ce0096,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:01.089467 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 34302) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:13:01.144016 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-3bf2708f-b476-47ba-b808-b47fcecfa00b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-872235', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4227786', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4279947'] for subnet, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.149383 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-44d7d7f6-2071-4233-b5b6-ece1a22a2879 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.155982 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 34304) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:13:01.172450 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bf2708f-b476-47ba-b808-b47fcecfa00b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a4ec70e4-58ed-4fe0-83d4-9b640ac7073b,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:01.174423 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-3bf2708f-b476-47ba-b808-b47fcecfa00b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for subnet, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.180424 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-3bf2708f-b476-47ba-b808-b47fcecfa00b admin admin] 10.222.0.37 "DELETE /v2.0/subnets/a4ec70e4-58ed-4fe0-83d4-9b640ac7073b HTTP/1.1" status: 204 len: 168 time: 0.2770936 Nov 08 16:13:01.181170 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 34308) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:13:01.194950 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-44d7d7f6-2071-4233-b5b6-ece1a22a2879 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.249038 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8eb66ded-5f03-47fc-8f12-bff05d774cc2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1007047'] for network, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.259419 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-44d7d7f6-2071-4233-b5b6-ece1a22a2879 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.264348 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-44d7d7f6-2071-4233-b5b6-ece1a22a2879 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.266105 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-44d7d7f6-2071-4233-b5b6-ece1a22a2879 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/dcdcebf0-159f-4e13-880a-87b6d2ce0096 HTTP/1.1" status: 204 len: 168 time: 0.1754584 Nov 08 16:13:01.304796 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44d7d7f6-2071-4233-b5b6-ece1a22a2879 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dcdcebf0-159f-4e13-880a-87b6d2ce0096,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:01.316673 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0bd7837e-4f90-40eb-8646-52806ef94364 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.335424 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8eb66ded-5f03-47fc-8f12-bff05d774cc2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-869719', 'neutron.services.segments.db._delete_segments_for_network-8792877333297'] for network, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.360076 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-8eb66ded-5f03-47fc-8f12-bff05d774cc2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['29f5d55a-1b58-4c4e-8594-67df1305d49e']}} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:13:01.374699 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-8eb66ded-5f03-47fc-8f12-bff05d774cc2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f0f12789-e0cc-4226-88a3-6badac06d613') {'for_net_delete': True} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:13:01.375000 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-8eb66ded-5f03-47fc-8f12-bff05d774cc2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f0f12789-e0cc-4226-88a3-6badac06d613') {} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:13:01.388462 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8eb66ded-5f03-47fc-8f12-bff05d774cc2 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792877333818', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8047118'] for segment, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.414959 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8eb66ded-5f03-47fc-8f12-bff05d774cc2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.423274 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8eb66ded-5f03-47fc-8f12-bff05d774cc2 admin admin] Releasing vlan 152 on physical network physnet1 to pool {{(pid=101244) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 16:13:01.423753 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8eb66ded-5f03-47fc-8f12-bff05d774cc2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4227628'] for segment, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: Traceback (most recent call last): Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: timer() Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: cb(*args, **kw) Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: return func(*args, **kwargs) Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: self._notify() Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: self.callback(batched_events) Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: event.method(event) Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: return f(self, *a, **k) Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: return self._get(url).json() Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: return self.request(url, 'GET', **kwargs) Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 16:13:01.426167 dv-cinder-816187-2-iscsi neutron-server[101244]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 16:13:01.433454 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0bd7837e-4f90-40eb-8646-52806ef94364 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.438755 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0bd7837e-4f90-40eb-8646-52806ef94364 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.491132 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bd7837e-4f90-40eb-8646-52806ef94364 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0a22a24d-dc8e-41a0-8125-5b2898d1f7a9,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:01.497782 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-0bd7837e-4f90-40eb-8646-52806ef94364 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=3445c25f739248b08f9d0f3a3ab8ed82&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3393488 Nov 08 16:13:01.502868 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 34316) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:13:01.505849 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8eb66ded-5f03-47fc-8f12-bff05d774cc2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-868772', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-2032313'] for network, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.534032 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8eb66ded-5f03-47fc-8f12-bff05d774cc2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.536738 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-8eb66ded-5f03-47fc-8f12-bff05d774cc2 admin admin] 10.222.0.37 "DELETE /v2.0/networks/29f5d55a-1b58-4c4e-8594-67df1305d49e HTTP/1.1" status: 204 len: 168 time: 0.3544981 Nov 08 16:13:01.548853 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8eb66ded-5f03-47fc-8f12-bff05d774cc2 admin admin] Pushing event deleted for resources: {'Network': ['ID=29f5d55a-1b58-4c4e-8594-67df1305d49e,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:01.570482 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-567169c5-322a-42c3-b322-dfe93626d957 req-10323c42-64af-4dc8-99da-df7409711a18 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:01.577882 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-567169c5-322a-42c3-b322-dfe93626d957 req-10323c42-64af-4dc8-99da-df7409711a18 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0869367 Nov 08 16:13:01.592114 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1188887f-9553-4bcf-9b85-77bbddd61536 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.615509 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1188887f-9553-4bcf-9b85-77bbddd61536 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.645322 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-567169c5-322a-42c3-b322-dfe93626d957 req-0813e4af-e71d-4e9d-82c0-0bc543d25ea1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524833 Nov 08 16:13:01.669176 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1188887f-9553-4bcf-9b85-77bbddd61536 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.671808 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1188887f-9553-4bcf-9b85-77bbddd61536 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.672948 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-1188887f-9553-4bcf-9b85-77bbddd61536 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/0a22a24d-dc8e-41a0-8125-5b2898d1f7a9 HTTP/1.1" status: 204 len: 168 time: 0.1693456 Nov 08 16:13:01.681361 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1188887f-9553-4bcf-9b85-77bbddd61536 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0a22a24d-dc8e-41a0-8125-5b2898d1f7a9,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:01.764927 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 34328) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:13:01.811497 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-d929384f-5978-46dd-b22c-1a347691b60b admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=859be553d1524a69b404983add5dfd9d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0454044 Nov 08 16:13:01.814329 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 34332) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:13:01.884238 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-71ad1d6a-bdfb-4089-a0c6-f1b70d04bdab admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.906816 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-71ad1d6a-bdfb-4089-a0c6-f1b70d04bdab admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:01.983434 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12bffce1-34af-4803-8730-0cb43ec8ad24 req-98f50814-df29-4b39-806f-a28aa276d831 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:01.985030 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-12bffce1-34af-4803-8730-0cb43ec8ad24 req-98f50814-df29-4b39-806f-a28aa276d831 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=1400ac35-c2ae-4814-ac9b-d18094175dce HTTP/1.1" status: 200 len: 944 time: 0.0692356 Nov 08 16:13:02.001605 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-71ad1d6a-bdfb-4089-a0c6-f1b70d04bdab admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:02.004256 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-71ad1d6a-bdfb-4089-a0c6-f1b70d04bdab admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:02.005426 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-71ad1d6a-bdfb-4089-a0c6-f1b70d04bdab admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/f8564259-b49a-4641-9316-603ecdce224e HTTP/1.1" status: 204 len: 168 time: 0.1900444 Nov 08 16:13:02.027750 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71ad1d6a-bdfb-4089-a0c6-f1b70d04bdab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f8564259-b49a-4641-9316-603ecdce224e,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:02.292835 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-12bffce1-34af-4803-8730-0cb43ec8ad24 req-fad5f256-f9d3-4a3c-881d-5928d4d17327 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2988691 Nov 08 16:13:02.447399 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 34368) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:13:02.485214 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-c90691a5-b80a-4f5c-b6a0-e59493efacf8 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=f60f1e307563486baefb5bf234af8cd0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0366724 Nov 08 16:13:02.487789 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 34370) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:13:02.533787 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 34372) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:13:02.537152 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-99c01906-076f-4a23-b098-2f84c2a8392e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:02.564231 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-99c01906-076f-4a23-b098-2f84c2a8392e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:02.635063 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-99c01906-076f-4a23-b098-2f84c2a8392e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:02.639131 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-99c01906-076f-4a23-b098-2f84c2a8392e admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:02.642839 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-99c01906-076f-4a23-b098-2f84c2a8392e admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/2a76efba-a39b-4949-bff5-4b18b28d1321 HTTP/1.1" status: 204 len: 168 time: 0.1509440 Nov 08 16:13:02.650632 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99c01906-076f-4a23-b098-2f84c2a8392e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2a76efba-a39b-4949-bff5-4b18b28d1321,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:02.750479 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0bb74bd-86e7-47f1-86de-89e09dfab4ce req-6a9f2248-b073-41a2-818f-97794888d78f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:02.751989 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b0bb74bd-86e7-47f1-86de-89e09dfab4ce req-6a9f2248-b073-41a2-818f-97794888d78f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0529144 Nov 08 16:13:02.783419 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-8cfe3b11-7545-4a9c-b02d-16a9f00ae851 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-488867404-network', 'tenant_id': 'e5e827086bb348d190546b9a0c0ba087'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:13:02.824169 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b0bb74bd-86e7-47f1-86de-89e09dfab4ce req-d2d6f613-4d76-4a49-b54a-61e4c64330c4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0644011 Nov 08 16:13:02.825266 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8cfe3b11-7545-4a9c-b02d-16a9f00ae851 admin admin] Made reservation on behalf of e5e827086bb348d190546b9a0c0ba087 for: {'network': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:13:02.827786 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8cfe3b11-7545-4a9c-b02d-16a9f00ae851 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for network, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:02.838429 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8cfe3b11-7545-4a9c-b02d-16a9f00ae851 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:02.930308 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8cfe3b11-7545-4a9c-b02d-16a9f00ae851 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:02.936366 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8cfe3b11-7545-4a9c-b02d-16a9f00ae851 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:02.962225 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8cfe3b11-7545-4a9c-b02d-16a9f00ae851 admin admin] vlan segment allocate from pool success with {'vlan_id': 155, 'physical_network': 'physnet1'} {{(pid=101244) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 16:13:02.976019 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cfe3b11-7545-4a9c-b02d-16a9f00ae851 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5158333e-8a1f-4579-b040-8c9e867322b3,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:02.980983 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8cfe3b11-7545-4a9c-b02d-16a9f00ae851 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:02.981422 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.db.segments_db [None req-8cfe3b11-7545-4a9c-b02d-16a9f00ae851 admin admin] Added segment d89c6b3f-ecc6-4296-92e8-9f4a30c70af3 of type vlan for network 63da175a-847c-472d-b285-2df5d0b798a0 Nov 08 16:13:03.035587 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8cfe3b11-7545-4a9c-b02d-16a9f00ae851 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792876766172'] for network, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:03.064622 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8cfe3b11-7545-4a9c-b02d-16a9f00ae851 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for network, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:03.065910 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8cfe3b11-7545-4a9c-b02d-16a9f00ae851 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:03.066661 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8cfe3b11-7545-4a9c-b02d-16a9f00ae851 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:03.128992 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-8cfe3b11-7545-4a9c-b02d-16a9f00ae851 admin admin] 10.222.0.37 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.5940888 Nov 08 16:13:03.133088 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 34428) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:13:03.135215 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cfe3b11-7545-4a9c-b02d-16a9f00ae851 admin admin] Pushing event updated for resources: {'Network': ['ID=63da175a-847c-472d-b285-2df5d0b798a0,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:03.138860 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-4589f27a-1ac4-4e0d-8cca-66e3e6631990 admin admin] Request body: {'subnet': {'network_id': '63da175a-847c-472d-b285-2df5d0b798a0', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-488867404-subnet', 'tenant_id': 'e5e827086bb348d190546b9a0c0ba087', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:13:03.158992 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Network 63da175a-847c-472d-b285-2df5d0b798a0 details requested by agent ovs-agent-dv-cinder-816187-2-iscsi with host dv-cinder-816187-2-iscsi {{(pid=101246) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 16:13:03.185055 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4589f27a-1ac4-4e0d-8cca-66e3e6631990 admin admin] Made reservation on behalf of e5e827086bb348d190546b9a0c0ba087 for: {'subnet': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:13:03.189472 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4589f27a-1ac4-4e0d-8cca-66e3e6631990 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-6098797'] for subnet, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:03.385402 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4589f27a-1ac4-4e0d-8cca-66e3e6631990 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7464155', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-6098583'] for subnet, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:03.437974 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1af80f86-4002-41e7-88ea-03437c15218d req-143db657-76df-4077-8f44-6977d4d804ac tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:03.439709 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1af80f86-4002-41e7-88ea-03437c15218d req-143db657-76df-4077-8f44-6977d4d804ac tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=1400ac35-c2ae-4814-ac9b-d18094175dce HTTP/1.1" status: 200 len: 944 time: 0.0597317 Nov 08 16:13:03.452848 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4589f27a-1ac4-4e0d-8cca-66e3e6631990 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1f439244-c92a-4099-b428-ff553d72eb05,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:03.464069 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4589f27a-1ac4-4e0d-8cca-66e3e6631990 admin admin] Checking segment: {'id': 'd89c6b3f-ecc6-4296-92e8-9f4a30c70af3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': '63da175a-847c-472d-b285-2df5d0b798a0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:13:03.464671 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4589f27a-1ac4-4e0d-8cca-66e3e6631990 admin admin] Network hostable DHCP agents. Network: 63da175a-847c-472d-b285-2df5d0b798a0, hostable agents: ['a7e1e7ee-1ce2-474e-9688-58f0884991a4'], hosted agents: [] {{(pid=101245) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 16:13:03.486754 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4589f27a-1ac4-4e0d-8cca-66e3e6631990 admin admin] Network 63da175a-847c-472d-b285-2df5d0b798a0 is scheduled to be hosted by DHCP agent a7e1e7ee-1ce2-474e-9688-58f0884991a4 with binding_index 1 {{(pid=101245) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 16:13:03.508442 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1af80f86-4002-41e7-88ea-03437c15218d req-4300422a-5722-43fc-82d6-53ffcf0261c0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0605063 Nov 08 16:13:03.510705 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-4589f27a-1ac4-4e0d-8cca-66e3e6631990 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816187-2-iscsi, 63da175a-847c-472d-b285-2df5d0b798a0) {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:13:03.520343 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4589f27a-1ac4-4e0d-8cca-66e3e6631990 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:03.521011 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4589f27a-1ac4-4e0d-8cca-66e3e6631990 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:03.521583 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-470d0cde-a6d0-41df-a0ab-e43b86a9f112 None None] Network 63da175a-847c-472d-b285-2df5d0b798a0 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:13:03.545862 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-4589f27a-1ac4-4e0d-8cca-66e3e6631990 admin admin] 10.222.0.37 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.4115624 Nov 08 16:13:03.576609 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 34458) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:13:03.639048 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device b2d31fb8-0a87-4aea-8200-914cd468d395 up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:13:03.696149 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-0409bba7-f0ef-4010-9052-18bcc1395ebd admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1698881072-network', 'tenant_id': '9580ccbb790e4dff94da99ac8b1c98d5'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:13:03.734264 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0409bba7-f0ef-4010-9052-18bcc1395ebd admin admin] Made reservation on behalf of 9580ccbb790e4dff94da99ac8b1c98d5 for: {'network': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:13:03.737468 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0409bba7-f0ef-4010-9052-18bcc1395ebd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for network, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:03.750566 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0409bba7-f0ef-4010-9052-18bcc1395ebd admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:03.859062 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-84f9fe40-3860-43b0-8115-569ae3e68970 None None] Network 63da175a-847c-472d-b285-2df5d0b798a0 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:13:03.871934 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0409bba7-f0ef-4010-9052-18bcc1395ebd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:03.898037 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0409bba7-f0ef-4010-9052-18bcc1395ebd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:03.902046 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning for port b2d31fb8-0a87-4aea-8200-914cd468d395 completed by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 16:13:03.908107 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port b2d31fb8-0a87-4aea-8200-914cd468d395 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:13:03.908355 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:03.975228 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0409bba7-f0ef-4010-9052-18bcc1395ebd admin admin] vlan segment allocate from pool success with {'vlan_id': 189, 'physical_network': 'physnet1'} {{(pid=101245) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 16:13:03.992984 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0409bba7-f0ef-4010-9052-18bcc1395ebd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7980e368-4ba2-4f63-995b-685d9baec7a2,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:04.002326 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0409bba7-f0ef-4010-9052-18bcc1395ebd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:04.002674 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.db.segments_db [None req-0409bba7-f0ef-4010-9052-18bcc1395ebd admin admin] Added segment 4d73fdfb-694f-4679-be5c-5e9ca8483c31 of type vlan for network e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e Nov 08 16:13:04.042612 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6414c42-020f-422c-87d9-155bca2f61ea req-9a438788-7d01-48f0-ae58-323e092f2f09 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:04.057111 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0409bba7-f0ef-4010-9052-18bcc1395ebd admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792876766172'] for network, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:04.057490 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f6414c42-020f-422c-87d9-155bca2f61ea req-9a438788-7d01-48f0-ae58-323e092f2f09 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.1203034 Nov 08 16:13:04.057649 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:04.096361 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0409bba7-f0ef-4010-9052-18bcc1395ebd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for network, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:04.097888 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0409bba7-f0ef-4010-9052-18bcc1395ebd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:04.098820 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0409bba7-f0ef-4010-9052-18bcc1395ebd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:04.120334 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port b2d31fb8-0a87-4aea-8200-914cd468d395, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=b2d31fb8-0a87-4aea-8200-914cd468d395,segment=NetworkSegment(fab7ad78-c438-48e7-8fdb-80ff50b8600c),segment_id=fab7ad78-c438-48e7-8fdb-80ff50b8600c)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:13:04.121281 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1400ac35-c2ae-4814-ac9b-d18094175dce', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b2d31fb8-0a87-4aea-8200-914cd468d395'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:13:04.122524 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f6414c42-020f-422c-87d9-155bca2f61ea req-45a6844e-eb84-4424-98ac-5152142249f2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0617721 Nov 08 16:13:04.126018 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-0409bba7-f0ef-4010-9052-18bcc1395ebd admin admin] 10.222.0.37 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.5450418 Nov 08 16:13:04.126144 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-07163034-d464-4093-918f-2f544a9f7a2d" -d '{"events": [{"server_uuid": "1400ac35-c2ae-4814-ac9b-d18094175dce", "name": "network-vif-plugged", "status": "completed", "tag": "b2d31fb8-0a87-4aea-8200-914cd468d395"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:13:04.126807 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 34486) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:13:04.127836 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:04.148843 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-b360b363-aa5b-4060-ab84-c76f4c498118 admin admin] Request body: {'subnet': {'network_id': 'e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1698881072-subnet', 'tenant_id': '9580ccbb790e4dff94da99ac8b1c98d5', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:13:04.191979 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b360b363-aa5b-4060-ab84-c76f4c498118 admin admin] Made reservation on behalf of 9580ccbb790e4dff94da99ac8b1c98d5 for: {'subnet': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:13:04.195220 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b360b363-aa5b-4060-ab84-c76f4c498118 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4280170'] for subnet, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:04.202646 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:13:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-47eacf45-4e02-4289-aa5a-096db08d4f50 x-openstack-request-id: req-47eacf45-4e02-4289-aa5a-096db08d4f50 {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:13:04.203166 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1400ac35-c2ae-4814-ac9b-d18094175dce", "name": "network-vif-plugged", "status": "completed", "tag": "b2d31fb8-0a87-4aea-8200-914cd468d395", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:13:04.203166 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-47eacf45-4e02-4289-aa5a-096db08d4f50 {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:13:04.203542 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1400ac35-c2ae-4814-ac9b-d18094175dce', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b2d31fb8-0a87-4aea-8200-914cd468d395', 'code': 200} Nov 08 16:13:04.205163 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=b2d31fb8-0a87-4aea-8200-914cd468d395,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:04.213803 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:04.214353 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:04.215323 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:04.215798 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:04.215912 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0409bba7-f0ef-4010-9052-18bcc1395ebd admin admin] Pushing event updated for resources: {'Network': ['ID=e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:04.216381 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:04.216846 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:04.217317 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:04.217864 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:04.218348 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:04.218677 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:04.218991 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:04.219549 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:04.234444 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Network e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e details requested by agent ovs-agent-dv-cinder-816187-2-iscsi with host dv-cinder-816187-2-iscsi {{(pid=101246) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 16:13:04.452226 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b360b363-aa5b-4060-ab84-c76f4c498118 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-4227723', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4279952'] for subnet, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:04.496990 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c397c23c-fd14-465a-809a-b85f69bf08c7 req-f3c898f2-70b4-4c4e-b82c-d1e45d8bf44e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:04.498751 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c397c23c-fd14-465a-809a-b85f69bf08c7 req-f3c898f2-70b4-4c4e-b82c-d1e45d8bf44e service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=1400ac35-c2ae-4814-ac9b-d18094175dce HTTP/1.1" status: 200 len: 1098 time: 0.0907044 Nov 08 16:13:04.526590 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b360b363-aa5b-4060-ab84-c76f4c498118 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d10afa0f-2bc3-4957-b3e4-84967992ae54,revision_number=0']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:04.546147 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b360b363-aa5b-4060-ab84-c76f4c498118 admin admin] Checking segment: {'id': '4d73fdfb-694f-4679-be5c-5e9ca8483c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 189, 'network_id': 'e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:13:04.546500 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b360b363-aa5b-4060-ab84-c76f4c498118 admin admin] Network hostable DHCP agents. Network: e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e, hostable agents: ['a7e1e7ee-1ce2-474e-9688-58f0884991a4'], hosted agents: [] {{(pid=101244) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 16:13:04.576536 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c397c23c-fd14-465a-809a-b85f69bf08c7 req-60e5c99c-37e7-46dc-850c-c066db2614c2 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595436 Nov 08 16:13:04.582072 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b360b363-aa5b-4060-ab84-c76f4c498118 admin admin] Network e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e is scheduled to be hosted by DHCP agent a7e1e7ee-1ce2-474e-9688-58f0884991a4 with binding_index 1 {{(pid=101244) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 16:13:04.591164 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-b360b363-aa5b-4060-ab84-c76f4c498118 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816187-2-iscsi, e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e) {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:13:04.597153 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b360b363-aa5b-4060-ab84-c76f4c498118 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:04.598104 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b360b363-aa5b-4060-ab84-c76f4c498118 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for subnet, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:04.599245 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b4a06be-ed0b-4750-b2cd-6beab56defca None None] Network e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:13:04.632672 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-b360b363-aa5b-4060-ab84-c76f4c498118 admin admin] 10.222.0.37 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.4862592 Nov 08 16:13:04.679846 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-715251e8-b755-4fae-b2dc-eb0a8761e638 req-7e8d374c-8c0e-43e3-bb9b-85e8b602d799 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:04.681331 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-715251e8-b755-4fae-b2dc-eb0a8761e638 req-7e8d374c-8c0e-43e3-bb9b-85e8b602d799 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=1400ac35-c2ae-4814-ac9b-d18094175dce HTTP/1.1" status: 200 len: 945 time: 0.0716562 Nov 08 16:13:04.734557 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-715251e8-b755-4fae-b2dc-eb0a8761e638 req-a10900fb-616e-4f68-9ee5-660d7f33e79d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471733 Nov 08 16:13:04.739408 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb022b06-ef27-4c22-b2aa-881364bf5350 None None] Network e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:13:05.251211 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e945a12-62d9-4622-9199-7b6fb4acd2a6 req-bb14a3ad-5eee-4d68-b44c-9acb936ceb6f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:05.252583 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9e945a12-62d9-4622-9199-7b6fb4acd2a6 req-bb14a3ad-5eee-4d68-b44c-9acb936ceb6f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0541744 Nov 08 16:13:05.298094 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9e945a12-62d9-4622-9199-7b6fb4acd2a6 req-550b57be-af7e-4b00-bdb1-6eeab2f9f95d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396163 Nov 08 16:13:05.847503 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbca1aba-6bff-422a-8b2e-9ccc19c2c02d req-25bba9fe-af13-47b3-a319-8231583d2240 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:05.849188 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bbca1aba-6bff-422a-8b2e-9ccc19c2c02d req-25bba9fe-af13-47b3-a319-8231583d2240 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=1400ac35-c2ae-4814-ac9b-d18094175dce HTTP/1.1" status: 200 len: 945 time: 0.0474639 Nov 08 16:13:05.896539 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bbca1aba-6bff-422a-8b2e-9ccc19c2c02d req-a2f128d8-0182-4262-a303-3654bab20cdc tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407517 Nov 08 16:13:06.414678 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d481316c-cbe7-42cc-a885-ed028e6419e9 req-6a4a838f-54c6-4408-9ede-977bc7da3cd2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:06.416147 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d481316c-cbe7-42cc-a885-ed028e6419e9 req-6a4a838f-54c6-4408-9ede-977bc7da3cd2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0520988 Nov 08 16:13:06.467845 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d481316c-cbe7-42cc-a885-ed028e6419e9 req-3e494e52-0ba0-4fe2-877e-ce38b509b074 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455742 Nov 08 16:13:06.592699 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9618f6e-4b33-456c-b714-e3901731c63b req-b9412cc3-bad7-4358-bf80-d3f11f4e7558 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:06.594207 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c9618f6e-4b33-456c-b714-e3901731c63b req-b9412cc3-bad7-4358-bf80-d3f11f4e7558 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/networks?id=63da175a-847c-472d-b285-2df5d0b798a0 HTTP/1.1" status: 200 len: 813 time: 0.1005821 Nov 08 16:13:06.608399 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c9618f6e-4b33-456c-b714-e3901731c63b req-239b8514-b796-43b8-8e0f-ec0e9e92dacb tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/quotas/e5e827086bb348d190546b9a0c0ba087 HTTP/1.1" status: 200 len: 375 time: 0.0087314 Nov 08 16:13:06.639379 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c9618f6e-4b33-456c-b714-e3901731c63b req-0c5cbb52-8cff-41a4-8545-77b2d73f08f2 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?tenant_id=e5e827086bb348d190546b9a0c0ba087&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0258646 Nov 08 16:13:06.746506 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c9618f6e-4b33-456c-b714-e3901731c63b req-953a582e-4041-4ebf-af23-8372a2fd2353 service neutron] 10.222.0.37 "GET /v2.0/networks/63da175a-847c-472d-b285-2df5d0b798a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0989592 Nov 08 16:13:06.830381 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c9618f6e-4b33-456c-b714-e3901731c63b req-2fefaa82-711f-4022-88a7-b7ba45ee57bd service neutron] 10.222.0.37 "GET /v2.0/networks/63da175a-847c-472d-b285-2df5d0b798a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0830302 Nov 08 16:13:07.001012 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d38b6505-5582-4245-afba-071fee5d3904 req-0b79cd87-77e7-406f-a253-085ea8ab8af1 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 210 time: 0.0419464 Nov 08 16:13:07.048136 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a957daa2-32ba-4667-9e28-e4093a158f8f req-7465a108-233b-4bfe-9b64-95c67a00e8ba tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:07.049760 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a957daa2-32ba-4667-9e28-e4093a158f8f req-7465a108-233b-4bfe-9b64-95c67a00e8ba tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=1400ac35-c2ae-4814-ac9b-d18094175dce HTTP/1.1" status: 200 len: 945 time: 0.0771005 Nov 08 16:13:07.101021 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a957daa2-32ba-4667-9e28-e4093a158f8f req-6d0883b6-971d-4aa1-9a1b-2199d807181a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437706 Nov 08 16:13:07.439498 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-9a3dd46d-d769-4fc0-a768-af68d471d369 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:07.448396 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-9a3dd46d-d769-4fc0-a768-af68d471d369 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/networks?id=e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e HTTP/1.1" status: 200 len: 809 time: 0.1388700 Nov 08 16:13:07.459476 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-05d52fe9-7dde-491f-af1d-45e49d0de5ea tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/quotas/9580ccbb790e4dff94da99ac8b1c98d5 HTTP/1.1" status: 200 len: 375 time: 0.0097322 Nov 08 16:13:07.492161 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-aef0a0bd-bfea-48cd-bb68-c088eb479cbc tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?tenant_id=9580ccbb790e4dff94da99ac8b1c98d5&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0273814 Nov 08 16:13:07.629239 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83e9b8d2-7754-471c-bc3f-77603153d2a0 req-3e2afd31-31e8-47a0-a526-e1676299fb52 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:07.630627 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-83e9b8d2-7754-471c-bc3f-77603153d2a0 req-3e2afd31-31e8-47a0-a526-e1676299fb52 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0852575 Nov 08 16:13:07.633324 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-62f8ca4b-49e6-4e7d-ad6f-d2b6434d3246 service neutron] 10.222.0.37 "GET /v2.0/networks/e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1333261 Nov 08 16:13:07.729785 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-83e9b8d2-7754-471c-bc3f-77603153d2a0 req-adf75f36-0ce9-4f92-a0ae-5638fc235d97 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0926001 Nov 08 16:13:07.754117 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-02c8d84b-e98a-451b-b31f-1cada8bf2158 service neutron] 10.222.0.37 "GET /v2.0/networks/e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1112986 Nov 08 16:13:07.918476 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-54ea8200-4bf4-432b-885e-69758c876ff5 req-e9ca1317-1f03-4a29-989c-cf12227f5ab6 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=2be55525-c510-4909-a898-370d4760deea HTTP/1.1" status: 200 len: 210 time: 0.0304630 Nov 08 16:13:08.109065 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-01c94a23-b0ae-437d-8e3d-1e258ff83fb4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:08.122107 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a916e44d-832a-4c98-b762-2889a21c4622 req-29a1233c-a802-4856-ba32-e9a41661608e tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 210 time: 0.0442798 Nov 08 16:13:08.170414 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9618f6e-4b33-456c-b714-e3901731c63b req-1e1b417d-0849-464b-920c-b0a1533490bf tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:08.172170 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c9618f6e-4b33-456c-b714-e3901731c63b req-1e1b417d-0849-464b-920c-b0a1533490bf tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.25 "GET /v2.0/networks?id=63da175a-847c-472d-b285-2df5d0b798a0 HTTP/1.1" status: 200 len: 813 time: 0.1552689 Nov 08 16:13:08.193030 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-c9618f6e-4b33-456c-b714-e3901731c63b req-42429eb0-76de-4496-98d6-c9071dd51cbd tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Request body: {'port': {'device_id': 'e41a90ba-f4f1-472e-9883-150d31bcc777', 'network_id': '63da175a-847c-472d-b285-2df5d0b798a0', 'admin_state_up': True, 'tenant_id': 'e5e827086bb348d190546b9a0c0ba087'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:13:08.320011 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c9618f6e-4b33-456c-b714-e3901731c63b req-42429eb0-76de-4496-98d6-c9071dd51cbd tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Made reservation on behalf of e5e827086bb348d190546b9a0c0ba087 for: {'port': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:13:08.323748 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-c9618f6e-4b33-456c-b714-e3901731c63b req-42429eb0-76de-4496-98d6-c9071dd51cbd tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:08.462170 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [req-c9618f6e-4b33-456c-b714-e3901731c63b req-42429eb0-76de-4496-98d6-c9071dd51cbd tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Allocated IP 172.20.0.4 (63da175a-847c-472d-b285-2df5d0b798a0/1f439244-c92a-4099-b428-ff553d72eb05/69152346-0cf4-4b0a-9db9-f1bddb32dc4b) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:13:08.604295 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-c9618f6e-4b33-456c-b714-e3901731c63b req-42429eb0-76de-4496-98d6-c9071dd51cbd tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:08.637866 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-c9618f6e-4b33-456c-b714-e3901731c63b req-42429eb0-76de-4496-98d6-c9071dd51cbd tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:08.684275 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c9618f6e-4b33-456c-b714-e3901731c63b req-42429eb0-76de-4496-98d6-c9071dd51cbd tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Network 63da175a-847c-472d-b285-2df5d0b798a0 is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:13:08.691928 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [req-c9618f6e-4b33-456c-b714-e3901731c63b req-42429eb0-76de-4496-98d6-c9071dd51cbd tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:13:08.696585 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-c9618f6e-4b33-456c-b714-e3901731c63b req-42429eb0-76de-4496-98d6-c9071dd51cbd tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:13:08.700944 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42429eb0-76de-4496-98d6-c9071dd51cbd tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Pushing event updated for resources: {'Port': ['ID=69152346-0cf4-4b0a-9db9-f1bddb32dc4b,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:08.744556 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9618f6e-4b33-456c-b714-e3901731c63b req-42429eb0-76de-4496-98d6-c9071dd51cbd tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:08.745157 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-c9618f6e-4b33-456c-b714-e3901731c63b req-42429eb0-76de-4496-98d6-c9071dd51cbd tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:08.761336 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c9618f6e-4b33-456c-b714-e3901731c63b req-42429eb0-76de-4496-98d6-c9071dd51cbd tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5735874 Nov 08 16:13:08.785600 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-c9618f6e-4b33-456c-b714-e3901731c63b req-3776a131-4833-42fe-9bd9-b594a81e7272 service neutron] Request body: {'port': {'device_id': 'e41a90ba-f4f1-472e-9883-150d31bcc777', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81618'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:13:08.870073 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-c9618f6e-4b33-456c-b714-e3901731c63b req-3776a131-4833-42fe-9bd9-b594a81e7272 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:08.888275 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5778067-7477-49e5-8fa4-81edd15d294c req-555d3a7f-4afd-495a-9afd-ee595b8027cd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:08.889845 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b5778067-7477-49e5-8fa4-81edd15d294c req-555d3a7f-4afd-495a-9afd-ee595b8027cd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0865011 Nov 08 16:13:09.013093 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b5778067-7477-49e5-8fa4-81edd15d294c req-59c06270-f700-4950-b782-f6d903f74e0f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1164045 Nov 08 16:13:09.104910 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d6ed6b55-3d9f-441f-9829-c965b4df4420 req-251a123a-5b3b-424c-83a8-54d679802671 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=2be55525-c510-4909-a898-370d4760deea HTTP/1.1" status: 200 len: 210 time: 0.0295005 Nov 08 16:13:09.203707 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [req-c9618f6e-4b33-456c-b714-e3901731c63b req-3776a131-4833-42fe-9bd9-b594a81e7272 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 69152346-0cf4-4b0a-9db9-f1bddb32dc4b {{(pid=101244) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:13:09.213486 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-c9618f6e-4b33-456c-b714-e3901731c63b req-3776a131-4833-42fe-9bd9-b594a81e7272 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:09.269496 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.provisioning_blocks [req-c9618f6e-4b33-456c-b714-e3901731c63b req-3776a131-4833-42fe-9bd9-b594a81e7272 service neutron] Transition to ACTIVE for port object 69152346-0cf4-4b0a-9db9-f1bddb32dc4b will not be triggered until provisioned by entity L2. {{(pid=101244) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 16:13:09.291292 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43d0974b-9af9-4a2d-968a-a52ac5d47a4d req-c4c2801b-2adf-41ab-8ee9-b46a2e6e0c53 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:09.298422 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-43d0974b-9af9-4a2d-968a-a52ac5d47a4d req-c4c2801b-2adf-41ab-8ee9-b46a2e6e0c53 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 931 time: 0.0870585 Nov 08 16:13:09.301329 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-c9618f6e-4b33-456c-b714-e3901731c63b req-3776a131-4833-42fe-9bd9-b594a81e7272 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:09.371590 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-3d9f4023-61f9-4f8b-aa2d-2f5150b24134 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:09.373392 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-3d9f4023-61f9-4f8b-aa2d-2f5150b24134 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.25 "GET /v2.0/networks?id=e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e HTTP/1.1" status: 200 len: 809 time: 0.1284387 Nov 08 16:13:09.385676 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-43d0974b-9af9-4a2d-968a-a52ac5d47a4d req-f5ac60e1-773a-4268-bdd6-b4bb04633a32 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0861659 Nov 08 16:13:09.390231 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3776a131-4833-42fe-9bd9-b594a81e7272 service neutron] Pushing event updated for resources: {'Port': ['ID=69152346-0cf4-4b0a-9db9-f1bddb32dc4b,revision_number=2']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:09.403605 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-2fbcfa2d-d051-46f9-8f97-b62d984f8804 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Request body: {'port': {'device_id': '2be55525-c510-4909-a898-370d4760deea', 'network_id': 'e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e', 'admin_state_up': True, 'tenant_id': '9580ccbb790e4dff94da99ac8b1c98d5'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:13:09.473678 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-c9618f6e-4b33-456c-b714-e3901731c63b req-3776a131-4833-42fe-9bd9-b594a81e7272 service neutron] Attempting to bind port 69152346-0cf4-4b0a-9db9-f1bddb32dc4b on host hv-cinder-81618 for vnic_type normal with profile {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:13:09.474235 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-c9618f6e-4b33-456c-b714-e3901731c63b req-3776a131-4833-42fe-9bd9-b594a81e7272 service neutron] Attempting to bind port 69152346-0cf4-4b0a-9db9-f1bddb32dc4b by drivers openvswitch,hyperv on host hv-cinder-81618 at level 0 using segments [{'id': 'd89c6b3f-ecc6-4296-92e8-9f4a30c70af3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': '63da175a-847c-472d-b285-2df5d0b798a0'}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:13:09.474453 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9618f6e-4b33-456c-b714-e3901731c63b req-3776a131-4833-42fe-9bd9-b594a81e7272 service neutron] Attempting to bind port 69152346-0cf4-4b0a-9db9-f1bddb32dc4b on network 63da175a-847c-472d-b285-2df5d0b798a0 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:13:09.479372 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9618f6e-4b33-456c-b714-e3901731c63b req-3776a131-4833-42fe-9bd9-b594a81e7272 service neutron] Port 69152346-0cf4-4b0a-9db9-f1bddb32dc4b on network 63da175a-847c-472d-b285-2df5d0b798a0 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81618 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 16:13:09.479689 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9618f6e-4b33-456c-b714-e3901731c63b req-3776a131-4833-42fe-9bd9-b594a81e7272 service neutron] Attempting to bind port 69152346-0cf4-4b0a-9db9-f1bddb32dc4b on network 63da175a-847c-472d-b285-2df5d0b798a0 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:13:09.484398 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9618f6e-4b33-456c-b714-e3901731c63b req-3776a131-4833-42fe-9bd9-b594a81e7272 service neutron] Checking agent: {'id': '54bf9779-c14d-412a-90fc-96b4a6589d5a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81618', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'started_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 12, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:13:09.485222 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9618f6e-4b33-456c-b714-e3901731c63b req-3776a131-4833-42fe-9bd9-b594a81e7272 service neutron] Checking segment: {'id': 'd89c6b3f-ecc6-4296-92e8-9f4a30c70af3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': '63da175a-847c-472d-b285-2df5d0b798a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:13:09.485222 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9618f6e-4b33-456c-b714-e3901731c63b req-3776a131-4833-42fe-9bd9-b594a81e7272 service neutron] Bound using segment: {'id': 'd89c6b3f-ecc6-4296-92e8-9f4a30c70af3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': '63da175a-847c-472d-b285-2df5d0b798a0'} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:13:09.485617 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-c9618f6e-4b33-456c-b714-e3901731c63b req-3776a131-4833-42fe-9bd9-b594a81e7272 service neutron] Bound port: 69152346-0cf4-4b0a-9db9-f1bddb32dc4b, host: hv-cinder-81618, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd89c6b3f-ecc6-4296-92e8-9f4a30c70af3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': '63da175a-847c-472d-b285-2df5d0b798a0'}}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:13:09.486003 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-c9618f6e-4b33-456c-b714-e3901731c63b req-3776a131-4833-42fe-9bd9-b594a81e7272 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:09.523114 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-2fbcfa2d-d051-46f9-8f97-b62d984f8804 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Made reservation on behalf of 9580ccbb790e4dff94da99ac8b1c98d5 for: {'port': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:13:09.526703 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-2fbcfa2d-d051-46f9-8f97-b62d984f8804 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:09.564622 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-c9618f6e-4b33-456c-b714-e3901731c63b req-3776a131-4833-42fe-9bd9-b594a81e7272 service neutron] For port 69152346-0cf4-4b0a-9db9-f1bddb32dc4b, host hv-cinder-81618, cleared binding levels {{(pid=101244) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:13:09.567949 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-c9618f6e-4b33-456c-b714-e3901731c63b req-3776a131-4833-42fe-9bd9-b594a81e7272 service neutron] For port 69152346-0cf4-4b0a-9db9-f1bddb32dc4b, host hv-cinder-81618, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=69152346-0cf4-4b0a-9db9-f1bddb32dc4b,segment=NetworkSegment(d89c6b3f-ecc6-4296-92e8-9f4a30c70af3),segment_id=d89c6b3f-ecc6-4296-92e8-9f4a30c70af3)] {{(pid=101244) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:13:09.572985 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-c9618f6e-4b33-456c-b714-e3901731c63b req-3776a131-4833-42fe-9bd9-b594a81e7272 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:09.606748 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:13:09.609273 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9618f6e-4b33-456c-b714-e3901731c63b req-3776a131-4833-42fe-9bd9-b594a81e7272 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:09.609978 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-c9618f6e-4b33-456c-b714-e3901731c63b req-3776a131-4833-42fe-9bd9-b594a81e7272 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:09.611354 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c9618f6e-4b33-456c-b714-e3901731c63b req-3776a131-4833-42fe-9bd9-b594a81e7272 service neutron] 10.222.0.25 "PUT /v2.0/ports/69152346-0cf4-4b0a-9db9-f1bddb32dc4b HTTP/1.1" status: 200 len: 1093 time: 0.8301911 Nov 08 16:13:09.611795 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e41a90ba-f4f1-472e-9883-150d31bcc777', 'tag': '69152346-0cf4-4b0a-9db9-f1bddb32dc4b'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:13:09.614130 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f351a449-02f9-4f17-80e3-8c89d3c18899" -d '{"events": [{"name": "network-changed", "server_uuid": "e41a90ba-f4f1-472e-9883-150d31bcc777", "tag": "69152346-0cf4-4b0a-9db9-f1bddb32dc4b"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:13:09.637898 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3776a131-4833-42fe-9bd9-b594a81e7272 service neutron] Pushing event updated for resources: {'Port': ['ID=69152346-0cf4-4b0a-9db9-f1bddb32dc4b,revision_number=3']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:09.669606 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:13:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cc7192b7-506b-46b7-bf14-dc1fcb0d2936 x-openstack-request-id: req-cc7192b7-506b-46b7-bf14-dc1fcb0d2936 {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:13:09.669917 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e41a90ba-f4f1-472e-9883-150d31bcc777", "tag": "69152346-0cf4-4b0a-9db9-f1bddb32dc4b", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:13:09.670172 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-cc7192b7-506b-46b7-bf14-dc1fcb0d2936 {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:13:09.670580 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e41a90ba-f4f1-472e-9883-150d31bcc777', 'tag': '69152346-0cf4-4b0a-9db9-f1bddb32dc4b', 'status': 'completed', 'code': 200} Nov 08 16:13:09.673209 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_common [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-2fbcfa2d-d051-46f9-8f97-b62d984f8804 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Allocated IP 172.20.0.7 (e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e/d10afa0f-2bc3-4957-b3e4-84967992ae54/00b6d387-6249-49c0-81db-f2b5b8a1ce31) {{(pid=101245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:13:09.724198 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9618f6e-4b33-456c-b714-e3901731c63b req-bcc22afb-1efc-4f76-92c2-f188b8b58b71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:09.726315 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c9618f6e-4b33-456c-b714-e3901731c63b req-bcc22afb-1efc-4f76-92c2-f188b8b58b71 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e5e827086bb348d190546b9a0c0ba087&device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 1096 time: 0.0425265 Nov 08 16:13:09.775600 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c9618f6e-4b33-456c-b714-e3901731c63b req-bd654acc-7fb4-4323-9aff-4a706ef107eb service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=69152346-0cf4-4b0a-9db9-f1bddb32dc4b HTTP/1.1" status: 200 len: 217 time: 0.0402954 Nov 08 16:13:09.827839 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9618f6e-4b33-456c-b714-e3901731c63b req-ffec8fa0-f599-400d-9837-4519846d2e8a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:09.829908 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c9618f6e-4b33-456c-b714-e3901731c63b req-ffec8fa0-f599-400d-9837-4519846d2e8a service neutron] 10.222.0.25 "GET /v2.0/subnets?id=1f439244-c92a-4099-b428-ff553d72eb05 HTTP/1.1" status: 200 len: 853 time: 0.0463798 Nov 08 16:13:09.842383 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-2fbcfa2d-d051-46f9-8f97-b62d984f8804 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Publish callbacks [] for port, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:09.879100 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c9618f6e-4b33-456c-b714-e3901731c63b req-90d0c75e-2c2d-4a2b-b1ab-10470a10283a service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=63da175a-847c-472d-b285-2df5d0b798a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0348668 Nov 08 16:13:09.879987 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-2fbcfa2d-d051-46f9-8f97-b62d984f8804 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:09.942437 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-2fbcfa2d-d051-46f9-8f97-b62d984f8804 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Network e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:13:09.946017 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-2fbcfa2d-d051-46f9-8f97-b62d984f8804 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:13:09.951802 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-2fbcfa2d-d051-46f9-8f97-b62d984f8804 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Received port after_create {{(pid=101245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:13:09.977680 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fbcfa2d-d051-46f9-8f97-b62d984f8804 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Pushing event updated for resources: {'Port': ['ID=00b6d387-6249-49c0-81db-f2b5b8a1ce31,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:09.996532 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c9618f6e-4b33-456c-b714-e3901731c63b req-77b43075-3ec6-4e4a-89d4-b8105c70274b service neutron] 10.222.0.25 "GET /v2.0/networks/63da175a-847c-472d-b285-2df5d0b798a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1059475 Nov 08 16:13:10.004321 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-2fbcfa2d-d051-46f9-8f97-b62d984f8804 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:10.004915 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-2fbcfa2d-d051-46f9-8f97-b62d984f8804 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for port, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:10.020582 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-2fbcfa2d-d051-46f9-8f97-b62d984f8804 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6248884 Nov 08 16:13:10.135035 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38521342-5d26-45f2-af2a-6d5eb1e32a51 req-9cbf8672-43f0-45f1-abb6-7292de59fb37 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:10.136726 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-38521342-5d26-45f2-af2a-6d5eb1e32a51 req-9cbf8672-43f0-45f1-abb6-7292de59fb37 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0548606 Nov 08 16:13:10.198360 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-3ad28fc2-95ec-41b2-b317-d45ecb92c44a service neutron] Request body: {'port': {'device_id': '2be55525-c510-4909-a898-370d4760deea', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81618'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:13:10.219884 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-38521342-5d26-45f2-af2a-6d5eb1e32a51 req-3cb28f87-94e0-45e9-89cf-ac7150c656eb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0764287 Nov 08 16:13:10.275543 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-3ad28fc2-95ec-41b2-b317-d45ecb92c44a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:10.292764 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-854aa6d2-649c-4225-b747-94ec05b624f2 req-2846b5c7-49ef-40f8-b6a2-8fd8123b7b57 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:10.296523 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-854aa6d2-649c-4225-b747-94ec05b624f2 req-2846b5c7-49ef-40f8-b6a2-8fd8123b7b57 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=2be55525-c510-4909-a898-370d4760deea HTTP/1.1" status: 200 len: 931 time: 0.1225863 Nov 08 16:13:10.349330 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c9618f6e-4b33-456c-b714-e3901731c63b req-cd7037fc-a3ca-492e-865c-b35378b5790a service neutron] 10.222.0.25 "GET /v2.0/networks/63da175a-847c-472d-b285-2df5d0b798a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1449425 Nov 08 16:13:10.366469 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-854aa6d2-649c-4225-b747-94ec05b624f2 req-71f5133a-d3a7-4d8f-9f9b-4e431230d402 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0593407 Nov 08 16:13:10.444454 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f351a449-02f9-4f17-80e3-8c89d3c18899 req-369daf8d-e656-4727-b251-bacabeaeb98c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:10.445993 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f351a449-02f9-4f17-80e3-8c89d3c18899 req-369daf8d-e656-4727-b251-bacabeaeb98c service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e5e827086bb348d190546b9a0c0ba087&device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 1096 time: 0.0466902 Nov 08 16:13:10.558406 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.notifiers.nova [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-3ad28fc2-95ec-41b2-b317-d45ecb92c44a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 00b6d387-6249-49c0-81db-f2b5b8a1ce31 {{(pid=101245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:13:10.566664 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-3ad28fc2-95ec-41b2-b317-d45ecb92c44a service neutron] Publish callbacks [] for port, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:10.572853 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f54d8ae-2ac9-4ef0-a60e-8571ff081821 req-cc06195c-392d-4871-85e2-25e900a48e10 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:10.574405 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9f54d8ae-2ac9-4ef0-a60e-8571ff081821 req-cc06195c-392d-4871-85e2-25e900a48e10 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 943 time: 0.0985103 Nov 08 16:13:10.580971 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.provisioning_blocks [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-3ad28fc2-95ec-41b2-b317-d45ecb92c44a service neutron] Transition to ACTIVE for port object 00b6d387-6249-49c0-81db-f2b5b8a1ce31 will not be triggered until provisioned by entity L2. {{(pid=101245) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 16:13:10.583563 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-d4c1558d-646c-4298-b1bb-935bea5f66ba None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:10.589588 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-3ad28fc2-95ec-41b2-b317-d45ecb92c44a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7464016'] for port, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:10.592907 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f351a449-02f9-4f17-80e3-8c89d3c18899 req-f9bffeee-51b3-455d-9fc8-d99f0e05e22e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:10.594584 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f351a449-02f9-4f17-80e3-8c89d3c18899 req-f9bffeee-51b3-455d-9fc8-d99f0e05e22e service neutron] 10.222.0.25 "GET /v2.0/networks?id=63da175a-847c-472d-b285-2df5d0b798a0 HTTP/1.1" status: 200 len: 914 time: 0.1365058 Nov 08 16:13:10.655213 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f351a449-02f9-4f17-80e3-8c89d3c18899 req-a5f0f29d-ad34-4666-9ce7-0aff8e1d712a service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=69152346-0cf4-4b0a-9db9-f1bddb32dc4b HTTP/1.1" status: 200 len: 217 time: 0.0420501 Nov 08 16:13:10.659853 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ad28fc2-95ec-41b2-b317-d45ecb92c44a service neutron] Pushing event updated for resources: {'Port': ['ID=00b6d387-6249-49c0-81db-f2b5b8a1ce31,revision_number=2']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:10.669072 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9f54d8ae-2ac9-4ef0-a60e-8571ff081821 req-59e2ce95-9795-40dd-b554-aa476b64c6e4 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0855765 Nov 08 16:13:10.713182 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.managers [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-3ad28fc2-95ec-41b2-b317-d45ecb92c44a service neutron] Attempting to bind port 00b6d387-6249-49c0-81db-f2b5b8a1ce31 on host hv-cinder-81618 for vnic_type normal with profile {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:13:10.713607 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.managers [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-3ad28fc2-95ec-41b2-b317-d45ecb92c44a service neutron] Attempting to bind port 00b6d387-6249-49c0-81db-f2b5b8a1ce31 by drivers openvswitch,hyperv on host hv-cinder-81618 at level 0 using segments [{'id': '4d73fdfb-694f-4679-be5c-5e9ca8483c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 189, 'network_id': 'e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e'}] {{(pid=101245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:13:10.714017 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-3ad28fc2-95ec-41b2-b317-d45ecb92c44a service neutron] Attempting to bind port 00b6d387-6249-49c0-81db-f2b5b8a1ce31 on network e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:13:10.718333 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-3ad28fc2-95ec-41b2-b317-d45ecb92c44a service neutron] Port 00b6d387-6249-49c0-81db-f2b5b8a1ce31 on network e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81618 {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 16:13:10.718647 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-3ad28fc2-95ec-41b2-b317-d45ecb92c44a service neutron] Attempting to bind port 00b6d387-6249-49c0-81db-f2b5b8a1ce31 on network e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:13:10.724238 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-3ad28fc2-95ec-41b2-b317-d45ecb92c44a service neutron] Checking agent: {'id': '54bf9779-c14d-412a-90fc-96b4a6589d5a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81618', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'started_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 12, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:13:10.724563 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-3ad28fc2-95ec-41b2-b317-d45ecb92c44a service neutron] Checking segment: {'id': '4d73fdfb-694f-4679-be5c-5e9ca8483c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 189, 'network_id': 'e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:13:10.724933 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-3ad28fc2-95ec-41b2-b317-d45ecb92c44a service neutron] Bound using segment: {'id': '4d73fdfb-694f-4679-be5c-5e9ca8483c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 189, 'network_id': 'e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e'} {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:13:10.725932 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.managers [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-3ad28fc2-95ec-41b2-b317-d45ecb92c44a service neutron] Bound port: 00b6d387-6249-49c0-81db-f2b5b8a1ce31, host: hv-cinder-81618, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4d73fdfb-694f-4679-be5c-5e9ca8483c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 189, 'network_id': 'e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e'}}] {{(pid=101245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:13:10.726273 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-3ad28fc2-95ec-41b2-b317-d45ecb92c44a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:10.726709 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f351a449-02f9-4f17-80e3-8c89d3c18899 req-892a92ae-adb8-4a6b-bd5e-8f32e63aba67 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:10.728154 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f351a449-02f9-4f17-80e3-8c89d3c18899 req-892a92ae-adb8-4a6b-bd5e-8f32e63aba67 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=1f439244-c92a-4099-b428-ff553d72eb05 HTTP/1.1" status: 200 len: 853 time: 0.0544670 Nov 08 16:13:10.759566 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f351a449-02f9-4f17-80e3-8c89d3c18899 req-99f6aa2b-2680-4c02-810e-20de63e36b15 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=63da175a-847c-472d-b285-2df5d0b798a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0234666 Nov 08 16:13:10.786629 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-3ad28fc2-95ec-41b2-b317-d45ecb92c44a service neutron] For port 00b6d387-6249-49c0-81db-f2b5b8a1ce31, host hv-cinder-81618, cleared binding levels {{(pid=101245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:13:10.790813 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-3ad28fc2-95ec-41b2-b317-d45ecb92c44a service neutron] For port 00b6d387-6249-49c0-81db-f2b5b8a1ce31, host hv-cinder-81618, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=00b6d387-6249-49c0-81db-f2b5b8a1ce31,segment=NetworkSegment(4d73fdfb-694f-4679-be5c-5e9ca8483c31),segment_id=4d73fdfb-694f-4679-be5c-5e9ca8483c31)] {{(pid=101245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:13:10.798882 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-3ad28fc2-95ec-41b2-b317-d45ecb92c44a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7464016'] for port, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:10.835264 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-3ad28fc2-95ec-41b2-b317-d45ecb92c44a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:10.835883 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-3ad28fc2-95ec-41b2-b317-d45ecb92c44a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for port, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:10.837259 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-3ad28fc2-95ec-41b2-b317-d45ecb92c44a service neutron] 10.222.0.25 "PUT /v2.0/ports/00b6d387-6249-49c0-81db-f2b5b8a1ce31 HTTP/1.1" status: 200 len: 1093 time: 0.6436019 Nov 08 16:13:10.837688 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2be55525-c510-4909-a898-370d4760deea', 'tag': '00b6d387-6249-49c0-81db-f2b5b8a1ce31'}] {{(pid=101245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:13:10.840041 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9303bddee447de525cefc409d3d14f9dbe8ef1f21bfe9eb24fdef2609d4aa3c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2e12509b-06a3-474c-b471-ed9f12fad78c" -d '{"events": [{"name": "network-changed", "server_uuid": "2be55525-c510-4909-a898-370d4760deea", "tag": "00b6d387-6249-49c0-81db-f2b5b8a1ce31"}]}' {{(pid=101245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:13:10.858543 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f351a449-02f9-4f17-80e3-8c89d3c18899 req-c1fcec85-69ec-4267-9dbb-a4da925f24a1 service neutron] 10.222.0.25 "GET /v2.0/networks/63da175a-847c-472d-b285-2df5d0b798a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0888815 Nov 08 16:13:10.867220 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ad28fc2-95ec-41b2-b317-d45ecb92c44a service neutron] Pushing event updated for resources: {'Port': ['ID=00b6d387-6249-49c0-81db-f2b5b8a1ce31,revision_number=3']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:10.888862 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:13:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b61ea8b7-9404-423d-88a5-783e0952fdaf x-openstack-request-id: req-b61ea8b7-9404-423d-88a5-783e0952fdaf {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:13:10.889152 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2be55525-c510-4909-a898-370d4760deea", "tag": "00b6d387-6249-49c0-81db-f2b5b8a1ce31", "status": "completed", "code": 200}]} {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:13:10.890274 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-b61ea8b7-9404-423d-88a5-783e0952fdaf {{(pid=101245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:13:10.890274 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2be55525-c510-4909-a898-370d4760deea', 'tag': '00b6d387-6249-49c0-81db-f2b5b8a1ce31', 'status': 'completed', 'code': 200} Nov 08 16:13:10.958071 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f351a449-02f9-4f17-80e3-8c89d3c18899 req-41ac4559-7b4e-4242-999c-0a385e737554 service neutron] 10.222.0.25 "GET /v2.0/networks/63da175a-847c-472d-b285-2df5d0b798a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0917201 Nov 08 16:13:10.993276 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-e36e1029-bd37-4c9b-be3f-bfc6a82bcbf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:10.994818 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-e36e1029-bd37-4c9b-be3f-bfc6a82bcbf3 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=9580ccbb790e4dff94da99ac8b1c98d5&device_id=2be55525-c510-4909-a898-370d4760deea HTTP/1.1" status: 200 len: 1096 time: 0.0549669 Nov 08 16:13:11.230834 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-34896bf1-04de-47c5-9dfc-6ffb53b95824 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=00b6d387-6249-49c0-81db-f2b5b8a1ce31 HTTP/1.1" status: 200 len: 217 time: 0.0336599 Nov 08 16:13:11.281381 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-f66fa51b-6ad4-4465-9eac-8db5c5a87cee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:11.283001 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-f66fa51b-6ad4-4465-9eac-8db5c5a87cee service neutron] 10.222.0.25 "GET /v2.0/subnets?id=d10afa0f-2bc3-4957-b3e4-84967992ae54 HTTP/1.1" status: 200 len: 849 time: 0.0438955 Nov 08 16:13:11.319468 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-44d0f6c8-b4c2-4ce2-be58-0389be867f5e service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0270483 Nov 08 16:13:11.347287 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ac0d158-8c43-4dbd-8850-9723e223727c req-5ff2c508-ab22-4306-b1f2-7553d8243773 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:11.348352 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6ac0d158-8c43-4dbd-8850-9723e223727c req-5ff2c508-ab22-4306-b1f2-7553d8243773 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0528522 Nov 08 16:13:11.409834 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6ac0d158-8c43-4dbd-8850-9723e223727c req-47618dc5-14a7-436d-bd46-993b26c8d091 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0545993 Nov 08 16:13:11.441813 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-dbd7bd1f-2f60-4ff5-a479-4c8ff920bd66 service neutron] 10.222.0.25 "GET /v2.0/networks/e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1128278 Nov 08 16:13:11.514897 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:11.523893 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-000b40a6-6587-433b-9fc4-2d5887278f36 req-460c5dbf-dc6d-4dcc-8de3-7f423388d3c4 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:11.525369 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-000b40a6-6587-433b-9fc4-2d5887278f36 req-460c5dbf-dc6d-4dcc-8de3-7f423388d3c4 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=2be55525-c510-4909-a898-370d4760deea HTTP/1.1" status: 200 len: 943 time: 0.0515606 Nov 08 16:13:11.549341 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-d5677c92-fedf-430e-8530-ca0e5266d800 req-0cd5a9a5-ce5e-40e4-8ac2-2e2642855f8d service neutron] 10.222.0.25 "GET /v2.0/networks/e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0881982 Nov 08 16:13:11.572659 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-000b40a6-6587-433b-9fc4-2d5887278f36 req-4c4979d1-4b40-4961-a994-a71c966ce72b tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412977 Nov 08 16:13:11.641554 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e12509b-06a3-474c-b471-ed9f12fad78c req-a43aefa9-5ad4-4018-83fd-d300bddc9bd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:11.643043 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2e12509b-06a3-474c-b471-ed9f12fad78c req-a43aefa9-5ad4-4018-83fd-d300bddc9bd9 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=9580ccbb790e4dff94da99ac8b1c98d5&device_id=2be55525-c510-4909-a898-370d4760deea HTTP/1.1" status: 200 len: 1096 time: 0.0412989 Nov 08 16:13:11.730406 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e12509b-06a3-474c-b471-ed9f12fad78c req-1dbf0690-1175-4e23-af2b-f87e02dead39 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:11.731851 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2e12509b-06a3-474c-b471-ed9f12fad78c req-1dbf0690-1175-4e23-af2b-f87e02dead39 service neutron] 10.222.0.25 "GET /v2.0/networks?id=e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e HTTP/1.1" status: 200 len: 910 time: 0.0814364 Nov 08 16:13:11.782847 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a873980d-fbc0-4949-9ced-f4aea8e7e62e req-e9fb2986-ed90-4d6c-b99d-7002861531f2 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:11.784378 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a873980d-fbc0-4949-9ced-f4aea8e7e62e req-e9fb2986-ed90-4d6c-b99d-7002861531f2 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 943 time: 0.0476291 Nov 08 16:13:11.786458 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2e12509b-06a3-474c-b471-ed9f12fad78c req-b7f47d14-91ff-4b72-8a41-dd8aa991d643 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=00b6d387-6249-49c0-81db-f2b5b8a1ce31 HTTP/1.1" status: 200 len: 217 time: 0.0375142 Nov 08 16:13:11.830819 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a873980d-fbc0-4949-9ced-f4aea8e7e62e req-6844712b-2325-4e16-a04b-db75f3c92b0e tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400255 Nov 08 16:13:11.845078 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e12509b-06a3-474c-b471-ed9f12fad78c req-3d535a02-4d21-4bb5-bcda-bf1c3e4dc525 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:11.846588 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2e12509b-06a3-474c-b471-ed9f12fad78c req-3d535a02-4d21-4bb5-bcda-bf1c3e4dc525 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=d10afa0f-2bc3-4957-b3e4-84967992ae54 HTTP/1.1" status: 200 len: 849 time: 0.0486584 Nov 08 16:13:11.885003 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2e12509b-06a3-474c-b471-ed9f12fad78c req-fc79e0fa-66af-40bb-a8a2-46b22b879ec7 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0245440 Nov 08 16:13:11.994336 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2e12509b-06a3-474c-b471-ed9f12fad78c req-8e3feb10-8f80-4db6-b597-f023db3c320e service neutron] 10.222.0.25 "GET /v2.0/networks/e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0890524 Nov 08 16:13:12.086694 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2e12509b-06a3-474c-b471-ed9f12fad78c req-3ace9f9f-67a0-451a-9d62-065369b6178a service neutron] 10.222.0.25 "GET /v2.0/networks/e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0815790 Nov 08 16:13:12.732390 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b62ac07-f1b1-4698-af0f-7e5515bd9ea0 req-c6dfcace-ef3d-4096-a1c1-02cfaabe04f8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:12.733937 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7b62ac07-f1b1-4698-af0f-7e5515bd9ea0 req-c6dfcace-ef3d-4096-a1c1-02cfaabe04f8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.2560608 Nov 08 16:13:12.780059 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7b62ac07-f1b1-4698-af0f-7e5515bd9ea0 req-339f97e6-dfb0-4875-ba42-33ffb4048977 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403831 Nov 08 16:13:12.880253 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3dd87a6-80f0-48ea-8ef1-5ad6c9ccc1dd req-175ea90c-6286-43c4-ac94-9b98c9d957c7 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:12.882295 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f3dd87a6-80f0-48ea-8ef1-5ad6c9ccc1dd req-175ea90c-6286-43c4-ac94-9b98c9d957c7 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=2be55525-c510-4909-a898-370d4760deea HTTP/1.1" status: 200 len: 943 time: 0.0483484 Nov 08 16:13:12.928768 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f3dd87a6-80f0-48ea-8ef1-5ad6c9ccc1dd req-9df1c8c8-0fd0-4beb-b04c-1b0a61a65a99 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400159 Nov 08 16:13:13.038982 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-7b1909a2-eff7-4ead-81ad-8c774d9e3f85 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-706634952&fields=id&tenant_id=343d5ca096394f87bea0950aa3811a13 HTTP/1.1" status: 200 len: 267 time: 0.0716481 Nov 08 16:13:13.058264 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b6b7ffd-e25e-4fc4-b6f8-03a10ffbbae4 req-303606a1-32d9-47d8-af0d-7a9f5a427621 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:13.059739 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5b6b7ffd-e25e-4fc4-b6f8-03a10ffbbae4 req-303606a1-32d9-47d8-af0d-7a9f5a427621 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 943 time: 0.0739119 Nov 08 16:13:13.165612 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5b6b7ffd-e25e-4fc4-b6f8-03a10ffbbae4 req-080a71a5-f59d-427e-9cd9-e3fdb7c9f368 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0963593 Nov 08 16:13:13.189300 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-7afab215-cd90-4d88-925e-784be918d555 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:13.190761 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-7afab215-cd90-4d88-925e-784be918d555 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/networks?id=a15e051b-c130-4140-aaf2-a45ea7af5b43 HTTP/1.1" status: 200 len: 812 time: 0.1301725 Nov 08 16:13:13.205305 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-2e5b1b92-8d59-4506-aab6-b1ae2db52975 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/quotas/343d5ca096394f87bea0950aa3811a13 HTTP/1.1" status: 200 len: 375 time: 0.0089674 Nov 08 16:13:13.241414 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:13.260220 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-03aca1bd-eeaa-4041-8b47-b27aed7ea753 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?tenant_id=343d5ca096394f87bea0950aa3811a13&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0494111 Nov 08 16:13:13.357237 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-093bb45b-585e-4dfe-9f55-fb3fa33d7938 service neutron] 10.222.0.37 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837309 Nov 08 16:13:13.449051 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-9e4a1572-adfe-4475-9828-35f817ed8da0 service neutron] 10.222.0.37 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857146 Nov 08 16:13:13.730524 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-18602f6a-ae9b-4b8d-81b4-8b4fa9852221 req-b2a2c8d5-c67a-48f0-91d5-744ebc9bbcf4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 210 time: 0.0269034 Nov 08 16:13:13.902741 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80ebfd49-75fc-4579-aea6-8627d48c9f6c req-02f54f1e-7c84-478c-afa4-85398df14202 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:13.904312 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-80ebfd49-75fc-4579-aea6-8627d48c9f6c req-02f54f1e-7c84-478c-afa4-85398df14202 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0515563 Nov 08 16:13:13.955974 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:13.973549 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-80ebfd49-75fc-4579-aea6-8627d48c9f6c req-28ad5dfc-fbff-4876-a6da-60342566b91b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0621886 Nov 08 16:13:14.092960 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28f8301a-45ff-483d-a6b2-39cc603995a7 req-4721a932-f51e-4bac-bcea-7c03a30699ca tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:14.095055 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-28f8301a-45ff-483d-a6b2-39cc603995a7 req-4721a932-f51e-4bac-bcea-7c03a30699ca tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=2be55525-c510-4909-a898-370d4760deea HTTP/1.1" status: 200 len: 943 time: 0.0648775 Nov 08 16:13:14.149567 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-28f8301a-45ff-483d-a6b2-39cc603995a7 req-e9b0592a-ed3b-4612-b9f3-ae07c7bb921f tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0488763 Nov 08 16:13:14.279157 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7d1c9f5-bac8-4f0d-9d4c-4b88d0ca5846 req-30802f01-eb8c-447b-9867-caf40cacbfc1 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:14.280670 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a7d1c9f5-bac8-4f0d-9d4c-4b88d0ca5846 req-30802f01-eb8c-447b-9867-caf40cacbfc1 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 943 time: 0.0497785 Nov 08 16:13:14.333141 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a7d1c9f5-bac8-4f0d-9d4c-4b88d0ca5846 req-5ea5adab-7509-41af-879f-8e2381cda555 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449922 Nov 08 16:13:14.363228 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-f8b3ae3f-4f35-48ae-b803-1f40f633fd72 req-77144c44-e47e-4c71-9328-af9d5bb8f4c0 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0393827 Nov 08 16:13:14.462751 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8b3ae3f-4f35-48ae-b803-1f40f633fd72 req-2766a784-06ff-4a15-8069-2114410eb98f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:14.464098 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-f8b3ae3f-4f35-48ae-b803-1f40f633fd72 req-2766a784-06ff-4a15-8069-2114410eb98f service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=549e9715f7424ff5b3b252f354adafe9&device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 1098 time: 0.0434434 Nov 08 16:13:14.568015 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8b3ae3f-4f35-48ae-b803-1f40f633fd72 req-223fddcc-3eb0-48cf-8650-78062cce1b90 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:14.570131 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-f8b3ae3f-4f35-48ae-b803-1f40f633fd72 req-223fddcc-3eb0-48cf-8650-78062cce1b90 service neutron] 10.222.0.25 "GET /v2.0/networks?id=f70ee550-62a6-48db-bca5-a0b964bbcce9 HTTP/1.1" status: 200 len: 916 time: 0.0842214 Nov 08 16:13:14.613968 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-f8b3ae3f-4f35-48ae-b803-1f40f633fd72 req-6451c128-16e5-481d-a23d-3e2961a1f4a3 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4020a644-ef2e-4dd8-931a-cfccef4e7b15 HTTP/1.1" status: 200 len: 217 time: 0.0353527 Nov 08 16:13:14.665592 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8b3ae3f-4f35-48ae-b803-1f40f633fd72 req-0b81170e-453f-4e84-9c53-b364247c9225 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:14.667089 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-f8b3ae3f-4f35-48ae-b803-1f40f633fd72 req-0b81170e-453f-4e84-9c53-b364247c9225 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=cd23e532-b366-42a0-82e4-ec7326cf3b48 HTTP/1.1" status: 200 len: 855 time: 0.0444331 Nov 08 16:13:14.712544 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-f8b3ae3f-4f35-48ae-b803-1f40f633fd72 req-6b237e23-baa9-4b11-a269-27d7b57f7cdf service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=f70ee550-62a6-48db-bca5-a0b964bbcce9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0233176 Nov 08 16:13:14.821463 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-f8b3ae3f-4f35-48ae-b803-1f40f633fd72 req-0ae3c0aa-ffa1-4b1a-bc75-b0243bef66a1 service neutron] 10.222.0.25 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0973127 Nov 08 16:13:14.860208 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5a7f756c-42c7-43c0-b454-7fa1e620d633 req-728ee5af-b3f9-41e8-b40e-dcb2554864eb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 210 time: 0.0304341 Nov 08 16:13:14.919453 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-3c615f3f-1446-49f5-9e81-c46eea510cb0 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:14.920934 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-3c615f3f-1446-49f5-9e81-c46eea510cb0 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.25 "GET /v2.0/networks?id=a15e051b-c130-4140-aaf2-a45ea7af5b43 HTTP/1.1" status: 200 len: 812 time: 0.1612206 Nov 08 16:13:14.929137 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-f8b3ae3f-4f35-48ae-b803-1f40f633fd72 req-955d9011-03d3-43c1-923e-79cff107de36 service neutron] 10.222.0.25 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0971875 Nov 08 16:13:14.999099 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-44b7dd57-9ef1-4927-80ba-96ff8b3a29cf tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.25 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=343d5ca096394f87bea0950aa3811a13 HTTP/1.1" status: 200 len: 379 time: 0.0686126 Nov 08 16:13:15.010569 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-6416b9f9-9996-4497-90d2-2c8f1fd46e9d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Request body: {'port': {'device_id': 'd643b8f8-c205-49ba-8889-30842481b95f', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'admin_state_up': True, 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'security_groups': ['a52bd5f6-4026-4f07-a3d9-c70ec9af4076']}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:13:15.087510 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edd64cff-6bc1-4c8b-a496-18205fc21b3a req-4685cae7-dbf2-434f-a742-60b1fb041452 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:15.089133 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-edd64cff-6bc1-4c8b-a496-18205fc21b3a req-4685cae7-dbf2-434f-a742-60b1fb041452 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 1098 time: 0.0414305 Nov 08 16:13:15.130545 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c313c80d-4fbc-4528-a3d7-9adc7bc61f24 req-b71bcc15-3b01-46b1-8dbc-8167e2fd278b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:15.132059 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c313c80d-4fbc-4528-a3d7-9adc7bc61f24 req-b71bcc15-3b01-46b1-8dbc-8167e2fd278b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0777271 Nov 08 16:13:15.137537 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-edd64cff-6bc1-4c8b-a496-18205fc21b3a req-98852b50-85b9-4bc4-9fab-1f6982a15f4c service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390284 Nov 08 16:13:15.196854 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-6416b9f9-9996-4497-90d2-2c8f1fd46e9d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Made reservation on behalf of 343d5ca096394f87bea0950aa3811a13 for: {'port': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:13:15.200613 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-6416b9f9-9996-4497-90d2-2c8f1fd46e9d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:15.217868 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c313c80d-4fbc-4528-a3d7-9adc7bc61f24 req-b1ae2849-cf2e-41d9-a5fa-947a256c726e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0773804 Nov 08 16:13:15.344530 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf39a5ec-b611-4668-8a0c-9835f002a86b req-2776ec07-a0fb-4a3e-b0db-79b1ea8079e9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:15.345915 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cf39a5ec-b611-4668-8a0c-9835f002a86b req-2776ec07-a0fb-4a3e-b0db-79b1ea8079e9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=2be55525-c510-4909-a898-370d4760deea HTTP/1.1" status: 200 len: 943 time: 0.1163948 Nov 08 16:13:15.382132 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-6416b9f9-9996-4497-90d2-2c8f1fd46e9d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Allocated IP 172.20.0.14 (a15e051b-c130-4140-aaf2-a45ea7af5b43/6e4d65b1-4f2c-453a-847c-970dff985732/17d7004d-111e-4cfc-904c-a17ed005bc2f) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:13:15.418542 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cf39a5ec-b611-4668-8a0c-9835f002a86b req-8354218c-917b-4926-be92-3cccdd1216f7 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0654848 Nov 08 16:13:15.563452 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f62fa40f-2a82-4f11-ade5-267bd51fb977 req-b59e66d7-0399-43aa-b628-b4b225976e5c tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:15.564927 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f62fa40f-2a82-4f11-ade5-267bd51fb977 req-b59e66d7-0399-43aa-b628-b4b225976e5c tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 943 time: 0.0801327 Nov 08 16:13:15.595851 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-6416b9f9-9996-4497-90d2-2c8f1fd46e9d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:15.639884 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f62fa40f-2a82-4f11-ade5-267bd51fb977 req-4fa39e9c-c513-4bea-bb6f-1462314bfab8 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0666339 Nov 08 16:13:15.654085 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-6416b9f9-9996-4497-90d2-2c8f1fd46e9d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:15.697386 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-6416b9f9-9996-4497-90d2-2c8f1fd46e9d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Network a15e051b-c130-4140-aaf2-a45ea7af5b43 is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:13:15.700282 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-6416b9f9-9996-4497-90d2-2c8f1fd46e9d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:13:15.705923 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-6416b9f9-9996-4497-90d2-2c8f1fd46e9d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:13:15.731214 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 69152346-0cf4-4b0a-9db9-f1bddb32dc4b details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:13:15.734588 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6416b9f9-9996-4497-90d2-2c8f1fd46e9d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Pushing event updated for resources: {'Port': ['ID=17d7004d-111e-4cfc-904c-a17ed005bc2f,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:15.767885 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-6416b9f9-9996-4497-90d2-2c8f1fd46e9d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:15.768550 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-6416b9f9-9996-4497-90d2-2c8f1fd46e9d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:15.785456 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-6416b9f9-9996-4497-90d2-2c8f1fd46e9d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7788467 Nov 08 16:13:15.798742 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-876bf8c3-fd3d-4ac9-b04e-ec1fc9f44c72 service neutron] Request body: {'port': {'device_id': 'd643b8f8-c205-49ba-8889-30842481b95f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81618'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:13:15.839076 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 69152346-0cf4-4b0a-9db9-f1bddb32dc4b, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=69152346-0cf4-4b0a-9db9-f1bddb32dc4b,segment=NetworkSegment(d89c6b3f-ecc6-4296-92e8-9f4a30c70af3),segment_id=d89c6b3f-ecc6-4296-92e8-9f4a30c70af3)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:13:15.852215 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': '69152346-0cf4-4b0a-9db9-f1bddb32dc4b', 'network_id': '63da175a-847c-472d-b285-2df5d0b798a0', 'port_id': '69152346-0cf4-4b0a-9db9-f1bddb32dc4b', 'mac_address': 'fa:16:3e:d7:a7:b3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 155, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1f439244-c92a-4099-b428-ff553d72eb05', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:13:15.856531 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-876bf8c3-fd3d-4ac9-b04e-ec1fc9f44c72 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:15.905864 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:15.931859 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-b8cfbaec-3fbb-4d16-8788-8ff29001c5c5 None None] Provisioning complete for port 17d7004d-111e-4cfc-904c-a17ed005bc2f triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:13:15.932234 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-b8cfbaec-3fbb-4d16-8788-8ff29001c5c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:15.934841 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 69152346-0cf4-4b0a-9db9-f1bddb32dc4b {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:13:15.980631 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 69152346-0cf4-4b0a-9db9-f1bddb32dc4b, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=69152346-0cf4-4b0a-9db9-f1bddb32dc4b,segment=NetworkSegment(d89c6b3f-ecc6-4296-92e8-9f4a30c70af3),segment_id=d89c6b3f-ecc6-4296-92e8-9f4a30c70af3)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:13:15.987818 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:15.988797 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 00b6d387-6249-49c0-81db-f2b5b8a1ce31 details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:13:16.022442 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-b8cfbaec-3fbb-4d16-8788-8ff29001c5c5 None None] Port 17d7004d-111e-4cfc-904c-a17ed005bc2f cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:13:16.090453 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=69152346-0cf4-4b0a-9db9-f1bddb32dc4b,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:16.098107 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f60ad004-de7e-4a93-b750-fb325b283deb req-241643a1-c381-48bb-bb11-f397ab953c6d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:16.099706 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f60ad004-de7e-4a93-b750-fb325b283deb req-241643a1-c381-48bb-bb11-f397ab953c6d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 932 time: 0.1305678 Nov 08 16:13:16.144482 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 00b6d387-6249-49c0-81db-f2b5b8a1ce31, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=00b6d387-6249-49c0-81db-f2b5b8a1ce31,segment=NetworkSegment(4d73fdfb-694f-4679-be5c-5e9ca8483c31),segment_id=4d73fdfb-694f-4679-be5c-5e9ca8483c31)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:13:16.157070 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': '00b6d387-6249-49c0-81db-f2b5b8a1ce31', 'network_id': 'e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e', 'port_id': '00b6d387-6249-49c0-81db-f2b5b8a1ce31', 'mac_address': 'fa:16:3e:36:cd:1e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 189, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd10afa0f-2bc3-4957-b3e4-84967992ae54', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:13:16.176973 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f60ad004-de7e-4a93-b750-fb325b283deb req-19de0e42-f04a-42be-b745-97cd08a1bdd8 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0681081 Nov 08 16:13:16.212447 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:16.232952 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 00b6d387-6249-49c0-81db-f2b5b8a1ce31 {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:13:16.237368 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-876bf8c3-fd3d-4ac9-b04e-ec1fc9f44c72 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 17d7004d-111e-4cfc-904c-a17ed005bc2f {{(pid=101244) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:13:16.252446 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:16.262339 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-876bf8c3-fd3d-4ac9-b04e-ec1fc9f44c72 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:16.280500 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 00b6d387-6249-49c0-81db-f2b5b8a1ce31, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=00b6d387-6249-49c0-81db-f2b5b8a1ce31,segment=NetworkSegment(4d73fdfb-694f-4679-be5c-5e9ca8483c31),segment_id=4d73fdfb-694f-4679-be5c-5e9ca8483c31)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:13:16.280828 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.provisioning_blocks [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-876bf8c3-fd3d-4ac9-b04e-ec1fc9f44c72 service neutron] Transition to ACTIVE for port object 17d7004d-111e-4cfc-904c-a17ed005bc2f will not be triggered until provisioned by entity L2. {{(pid=101244) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 16:13:16.285840 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-876bf8c3-fd3d-4ac9-b04e-ec1fc9f44c72 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:16.286084 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:16.346746 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=00b6d387-6249-49c0-81db-f2b5b8a1ce31,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:16.406728 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-876bf8c3-fd3d-4ac9-b04e-ec1fc9f44c72 service neutron] Pushing event updated for resources: {'Port': ['ID=17d7004d-111e-4cfc-904c-a17ed005bc2f,revision_number=2']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:16.426564 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74bcb082-e3c3-4bcf-bb5f-e6f729fba0b4 req-4e9edd31-631e-441c-b67b-349abde9d5b0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:16.428691 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-74bcb082-e3c3-4bcf-bb5f-e6f729fba0b4 req-4e9edd31-631e-441c-b67b-349abde9d5b0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.1162560 Nov 08 16:13:16.473066 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-876bf8c3-fd3d-4ac9-b04e-ec1fc9f44c72 service neutron] Attempting to bind port 17d7004d-111e-4cfc-904c-a17ed005bc2f on host hv-cinder-81618 for vnic_type normal with profile {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:13:16.473404 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-876bf8c3-fd3d-4ac9-b04e-ec1fc9f44c72 service neutron] Attempting to bind port 17d7004d-111e-4cfc-904c-a17ed005bc2f by drivers openvswitch,hyperv on host hv-cinder-81618 at level 0 using segments [{'id': '1383b9f8-d178-4a90-828c-184fa1886253', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43'}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:13:16.473749 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-876bf8c3-fd3d-4ac9-b04e-ec1fc9f44c72 service neutron] Attempting to bind port 17d7004d-111e-4cfc-904c-a17ed005bc2f on network a15e051b-c130-4140-aaf2-a45ea7af5b43 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:13:16.486748 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-876bf8c3-fd3d-4ac9-b04e-ec1fc9f44c72 service neutron] Port 17d7004d-111e-4cfc-904c-a17ed005bc2f on network a15e051b-c130-4140-aaf2-a45ea7af5b43 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81618 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 16:13:16.487071 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-876bf8c3-fd3d-4ac9-b04e-ec1fc9f44c72 service neutron] Attempting to bind port 17d7004d-111e-4cfc-904c-a17ed005bc2f on network a15e051b-c130-4140-aaf2-a45ea7af5b43 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:13:16.510064 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-876bf8c3-fd3d-4ac9-b04e-ec1fc9f44c72 service neutron] Checking agent: {'id': '54bf9779-c14d-412a-90fc-96b4a6589d5a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81618', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'started_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 13, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:13:16.510397 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-876bf8c3-fd3d-4ac9-b04e-ec1fc9f44c72 service neutron] Checking segment: {'id': '1383b9f8-d178-4a90-828c-184fa1886253', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:13:16.510768 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-876bf8c3-fd3d-4ac9-b04e-ec1fc9f44c72 service neutron] Bound using segment: {'id': '1383b9f8-d178-4a90-828c-184fa1886253', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43'} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:13:16.511214 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-876bf8c3-fd3d-4ac9-b04e-ec1fc9f44c72 service neutron] Bound port: 17d7004d-111e-4cfc-904c-a17ed005bc2f, host: hv-cinder-81618, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1383b9f8-d178-4a90-828c-184fa1886253', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43'}}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:13:16.511563 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-876bf8c3-fd3d-4ac9-b04e-ec1fc9f44c72 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:16.520163 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-74bcb082-e3c3-4bcf-bb5f-e6f729fba0b4 req-cb949809-4c6a-4e71-b565-3497c64978b1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0806115 Nov 08 16:13:16.595305 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc642586-1d63-4492-b356-c63794896ce1 req-c74e95f2-4831-4a40-a940-c9aa846306e9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:16.596720 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fc642586-1d63-4492-b356-c63794896ce1 req-c74e95f2-4831-4a40-a940-c9aa846306e9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=2be55525-c510-4909-a898-370d4760deea HTTP/1.1" status: 200 len: 944 time: 0.0981441 Nov 08 16:13:16.629546 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-876bf8c3-fd3d-4ac9-b04e-ec1fc9f44c72 service neutron] For port 17d7004d-111e-4cfc-904c-a17ed005bc2f, host hv-cinder-81618, cleared binding levels {{(pid=101244) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:13:16.645333 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-876bf8c3-fd3d-4ac9-b04e-ec1fc9f44c72 service neutron] For port 17d7004d-111e-4cfc-904c-a17ed005bc2f, host hv-cinder-81618, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=17d7004d-111e-4cfc-904c-a17ed005bc2f,segment=NetworkSegment(1383b9f8-d178-4a90-828c-184fa1886253),segment_id=1383b9f8-d178-4a90-828c-184fa1886253)] {{(pid=101244) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:13:16.652204 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-876bf8c3-fd3d-4ac9-b04e-ec1fc9f44c72 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:16.700542 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fc642586-1d63-4492-b356-c63794896ce1 req-e3204131-ca3a-40a2-ad91-f237cd036cdd tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0944822 Nov 08 16:13:16.703408 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-876bf8c3-fd3d-4ac9-b04e-ec1fc9f44c72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:16.704033 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-876bf8c3-fd3d-4ac9-b04e-ec1fc9f44c72 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:16.705389 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-876bf8c3-fd3d-4ac9-b04e-ec1fc9f44c72 service neutron] 10.222.0.25 "PUT /v2.0/ports/17d7004d-111e-4cfc-904c-a17ed005bc2f HTTP/1.1" status: 200 len: 1094 time: 0.9111483 Nov 08 16:13:16.705939 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd643b8f8-c205-49ba-8889-30842481b95f', 'tag': '17d7004d-111e-4cfc-904c-a17ed005bc2f'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:13:16.709074 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3b03a114-ea2b-45b4-ae77-1eabd22484c3" -d '{"events": [{"name": "network-changed", "server_uuid": "d643b8f8-c205-49ba-8889-30842481b95f", "tag": "17d7004d-111e-4cfc-904c-a17ed005bc2f"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:13:16.758382 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-876bf8c3-fd3d-4ac9-b04e-ec1fc9f44c72 service neutron] Pushing event updated for resources: {'Port': ['ID=17d7004d-111e-4cfc-904c-a17ed005bc2f,revision_number=3']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:16.789212 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:13:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-069d1a61-8890-4334-9fcc-73f862972c1e x-openstack-request-id: req-069d1a61-8890-4334-9fcc-73f862972c1e {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:13:16.789523 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d643b8f8-c205-49ba-8889-30842481b95f", "tag": "17d7004d-111e-4cfc-904c-a17ed005bc2f", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:13:16.789767 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-069d1a61-8890-4334-9fcc-73f862972c1e {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:13:16.790160 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd643b8f8-c205-49ba-8889-30842481b95f', 'tag': '17d7004d-111e-4cfc-904c-a17ed005bc2f', 'status': 'completed', 'code': 200} Nov 08 16:13:16.836128 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c0d77b1-21f4-48aa-9ad9-44a1a716f948 req-1ed70c52-5aff-468a-bb8f-180f73698323 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:16.837825 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0c0d77b1-21f4-48aa-9ad9-44a1a716f948 req-1ed70c52-5aff-468a-bb8f-180f73698323 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 944 time: 0.0971582 Nov 08 16:13:16.844189 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-c894d2c5-f147-443e-8fe0-5dc722ba9fe4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:16.845822 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-c894d2c5-f147-443e-8fe0-5dc722ba9fe4 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=343d5ca096394f87bea0950aa3811a13&device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 1097 time: 0.0652909 Nov 08 16:13:16.903494 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-d838e5f9-e98a-4e26-8ecc-05172afb2b50 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=17d7004d-111e-4cfc-904c-a17ed005bc2f HTTP/1.1" status: 200 len: 217 time: 0.0366170 Nov 08 16:13:16.933018 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0c0d77b1-21f4-48aa-9ad9-44a1a716f948 req-1b587530-419f-4206-8652-9dbdfbbf6917 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0862224 Nov 08 16:13:16.969832 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-46c58970-bab5-46d3-a3e3-d302e243a3c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:16.971266 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-46c58970-bab5-46d3-a3e3-d302e243a3c0 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=6e4d65b1-4f2c-453a-847c-970dff985732 HTTP/1.1" status: 200 len: 851 time: 0.0534158 Nov 08 16:13:17.023320 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-36545541-9670-4cfb-b825-ab9ba3f4f0ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:17.024769 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-36545541-9670-4cfb-b825-ab9ba3f4f0ef service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=a15e051b-c130-4140-aaf2-a45ea7af5b43&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0393207 Nov 08 16:13:17.121020 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-1583b0d0-3da1-4f88-a9ed-9e3fd4f3e11f service neutron] 10.222.0.25 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0862253 Nov 08 16:13:17.218278 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8fcca3ff-ba6a-439e-993b-f065fe58c8e9 req-55be2fab-37e5-40b7-993b-b516f190cd56 service neutron] 10.222.0.25 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0886183 Nov 08 16:13:17.311433 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21d2b4b8-da79-4518-9aef-c44150b0fd6f req-bbe77087-ab6a-4698-8eaf-ae5ecc2d3074 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:17.315102 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-21d2b4b8-da79-4518-9aef-c44150b0fd6f req-bbe77087-ab6a-4698-8eaf-ae5ecc2d3074 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 944 time: 0.0682952 Nov 08 16:13:17.394434 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b03a114-ea2b-45b4-ae77-1eabd22484c3 req-dc091bdf-567e-4519-9385-de6c7714c75b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:17.395921 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3b03a114-ea2b-45b4-ae77-1eabd22484c3 req-dc091bdf-567e-4519-9385-de6c7714c75b service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=343d5ca096394f87bea0950aa3811a13&device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 1097 time: 0.0751629 Nov 08 16:13:17.401309 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-21d2b4b8-da79-4518-9aef-c44150b0fd6f req-f67a68e8-a46b-404a-b2e5-35314387875d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0721741 Nov 08 16:13:17.447064 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['69152346-0cf4-4b0a-9db9-f1bddb32dc4b'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:13:17.450718 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['00b6d387-6249-49c0-81db-f2b5b8a1ce31'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:13:17.496403 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b03a114-ea2b-45b4-ae77-1eabd22484c3 req-2107b642-db47-4f09-b172-60b9d650def6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:17.497889 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3b03a114-ea2b-45b4-ae77-1eabd22484c3 req-2107b642-db47-4f09-b172-60b9d650def6 service neutron] 10.222.0.25 "GET /v2.0/networks?id=a15e051b-c130-4140-aaf2-a45ea7af5b43 HTTP/1.1" status: 200 len: 913 time: 0.0924451 Nov 08 16:13:17.566575 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3b03a114-ea2b-45b4-ae77-1eabd22484c3 req-f803460c-f25e-4b3d-a6bf-e863d2e74764 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=17d7004d-111e-4cfc-904c-a17ed005bc2f HTTP/1.1" status: 200 len: 217 time: 0.0505486 Nov 08 16:13:17.681305 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b03a114-ea2b-45b4-ae77-1eabd22484c3 req-2d3ea9f9-9e66-4161-b769-b22b4256bc85 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:17.682869 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3b03a114-ea2b-45b4-ae77-1eabd22484c3 req-2d3ea9f9-9e66-4161-b769-b22b4256bc85 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=6e4d65b1-4f2c-453a-847c-970dff985732 HTTP/1.1" status: 200 len: 851 time: 0.1005206 Nov 08 16:13:17.710327 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9317adb9-5c2d-4633-9827-dc5e2ee747cf req-58b5a2c0-1664-45c6-b2bf-bec502e1c406 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:17.711816 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9317adb9-5c2d-4633-9827-dc5e2ee747cf req-58b5a2c0-1664-45c6-b2bf-bec502e1c406 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.1156917 Nov 08 16:13:17.795422 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9317adb9-5c2d-4633-9827-dc5e2ee747cf req-d7919e16-b7b4-4eff-a26f-9d2602045e4e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0761220 Nov 08 16:13:17.798821 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b03a114-ea2b-45b4-ae77-1eabd22484c3 req-3b366655-3b80-4697-ab0b-03ffdeea3897 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:17.799747 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3b03a114-ea2b-45b4-ae77-1eabd22484c3 req-3b366655-3b80-4697-ab0b-03ffdeea3897 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=a15e051b-c130-4140-aaf2-a45ea7af5b43&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0721412 Nov 08 16:13:17.957407 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77427e00-a7ed-4be3-a052-a210b39fc800 req-14ab9840-456c-4e86-974a-3425e090a6c6 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:17.958873 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-77427e00-a7ed-4be3-a052-a210b39fc800 req-14ab9840-456c-4e86-974a-3425e090a6c6 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=2be55525-c510-4909-a898-370d4760deea HTTP/1.1" status: 200 len: 944 time: 0.0807378 Nov 08 16:13:17.962662 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3b03a114-ea2b-45b4-ae77-1eabd22484c3 req-6158598f-3b71-4649-892e-54209a14d578 service neutron] 10.222.0.25 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1339779 Nov 08 16:13:18.055891 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b94e3f6-6eea-4af2-9d6a-bb070fc5dbdf req-46364236-0ad9-4597-a9d1-22374b92545c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:18.057585 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-5b94e3f6-6eea-4af2-9d6a-bb070fc5dbdf req-46364236-0ad9-4597-a9d1-22374b92545c service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=4818358a827143eb9ace58a26713cdf0&device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 1098 time: 0.0452399 Nov 08 16:13:18.091019 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-77427e00-a7ed-4be3-a052-a210b39fc800 req-22a21833-7795-48b2-b931-6b3c878e1557 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1250415 Nov 08 16:13:18.134774 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ff3a0b8-1310-4d8f-b565-3b75cb8af3dc req-d461093b-e1b7-45f3-a84e-551b7ef36c95 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:18.136318 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5ff3a0b8-1310-4d8f-b565-3b75cb8af3dc req-d461093b-e1b7-45f3-a84e-551b7ef36c95 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.1089876 Nov 08 16:13:18.172978 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b94e3f6-6eea-4af2-9d6a-bb070fc5dbdf req-be909573-388e-4845-98d2-fba81802ad0d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:18.173211 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3b03a114-ea2b-45b4-ae77-1eabd22484c3 req-da324937-ac38-4c82-8ecd-64cb6546224b service neutron] 10.222.0.25 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2001903 Nov 08 16:13:18.174496 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-5b94e3f6-6eea-4af2-9d6a-bb070fc5dbdf req-be909573-388e-4845-98d2-fba81802ad0d service neutron] 10.222.0.25 "GET /v2.0/networks?id=2d5b5768-37f3-49a1-b451-2803f6f97429 HTTP/1.1" status: 200 len: 919 time: 0.1055527 Nov 08 16:13:18.228683 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5ff3a0b8-1310-4d8f-b565-3b75cb8af3dc req-9a641b39-8eae-425a-a1fd-71b61a80d080 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0822630 Nov 08 16:13:18.240150 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-5b94e3f6-6eea-4af2-9d6a-bb070fc5dbdf req-2b33f9f7-0302-4ad1-b69b-75b4fe5cf80d service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=17db566c-bf28-4091-b7f6-4ffa5f80c982 HTTP/1.1" status: 200 len: 217 time: 0.0419252 Nov 08 16:13:18.247088 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f571975-aa73-4a20-a1c3-cce280fa3573 req-b86ed952-9b8e-4fa2-91cc-04b0e28244b9 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:18.252545 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0f571975-aa73-4a20-a1c3-cce280fa3573 req-b86ed952-9b8e-4fa2-91cc-04b0e28244b9 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 944 time: 0.0784683 Nov 08 16:13:18.309174 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b94e3f6-6eea-4af2-9d6a-bb070fc5dbdf req-5c2c9968-d464-41e0-ad4f-03366201b947 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:18.311025 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-5b94e3f6-6eea-4af2-9d6a-bb070fc5dbdf req-5c2c9968-d464-41e0-ad4f-03366201b947 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=6936707c-bd3f-4cd8-9462-a4af0ea16ed8 HTTP/1.1" status: 200 len: 858 time: 0.0513520 Nov 08 16:13:18.312076 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0f571975-aa73-4a20-a1c3-cce280fa3573 req-9df0f6cf-3c6c-4912-9c4f-4b454efff76e tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0572863 Nov 08 16:13:18.374818 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-5b94e3f6-6eea-4af2-9d6a-bb070fc5dbdf req-714ebaee-00cf-4fae-8e2b-1631e518bbff service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=2d5b5768-37f3-49a1-b451-2803f6f97429&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0384235 Nov 08 16:13:18.470012 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-5b94e3f6-6eea-4af2-9d6a-bb070fc5dbdf req-9608bee5-4cee-4c4e-a538-a07806aae2ea service neutron] 10.222.0.25 "GET /v2.0/networks/2d5b5768-37f3-49a1-b451-2803f6f97429?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0914721 Nov 08 16:13:18.524395 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae02aaae-c7c9-4607-900d-65194ebbc7db req-11bc48c6-1004-4867-a13d-c17693817473 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:18.525985 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ae02aaae-c7c9-4607-900d-65194ebbc7db req-11bc48c6-1004-4867-a13d-c17693817473 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 944 time: 0.0525746 Nov 08 16:13:18.579258 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-5b94e3f6-6eea-4af2-9d6a-bb070fc5dbdf req-dbbe94a4-fdb2-4f90-998b-0c15702e1d16 service neutron] 10.222.0.25 "GET /v2.0/networks/2d5b5768-37f3-49a1-b451-2803f6f97429?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0906496 Nov 08 16:13:18.586390 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ae02aaae-c7c9-4607-900d-65194ebbc7db req-42e53b2c-2df1-4125-98c3-6b4d02acae3f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0535643 Nov 08 16:13:19.219859 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d06cc4e3-ca12-4fd9-82a1-17321f0f2758 req-ffcab3cd-81c3-4d1b-ba37-6acaf4393a4f tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:19.221298 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d06cc4e3-ca12-4fd9-82a1-17321f0f2758 req-ffcab3cd-81c3-4d1b-ba37-6acaf4393a4f tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=2be55525-c510-4909-a898-370d4760deea HTTP/1.1" status: 200 len: 944 time: 0.0527880 Nov 08 16:13:19.267945 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d06cc4e3-ca12-4fd9-82a1-17321f0f2758 req-f2dfd09e-5c3d-47a1-9e1b-26f07ebb4e7e tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402474 Nov 08 16:13:19.353210 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea2b38e7-51c3-4bf1-9b23-4b56f691f744 req-cc0dbdf8-bb4b-4b23-80f0-076553f39f28 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:19.354742 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ea2b38e7-51c3-4bf1-9b23-4b56f691f744 req-cc0dbdf8-bb4b-4b23-80f0-076553f39f28 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0512338 Nov 08 16:13:19.426628 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ea2b38e7-51c3-4bf1-9b23-4b56f691f744 req-687a76e6-1144-4fc9-849b-a6932564a115 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0659404 Nov 08 16:13:19.445549 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcaedc0c-ab28-4fd5-8331-876edcf06566 req-3b825018-13a8-4462-b54a-61b4281d8184 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:19.447033 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dcaedc0c-ab28-4fd5-8331-876edcf06566 req-3b825018-13a8-4462-b54a-61b4281d8184 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 944 time: 0.0645359 Nov 08 16:13:19.710269 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dcaedc0c-ab28-4fd5-8331-876edcf06566 req-cbf268c2-d5bf-4f22-bceb-0d3f126b0586 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2573593 Nov 08 16:13:19.744266 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81ba0e52-ae0d-45cf-ac5f-820570e9c731 req-84858d50-9d11-4089-aadc-729d136aa33d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:19.745714 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-81ba0e52-ae0d-45cf-ac5f-820570e9c731 req-84858d50-9d11-4089-aadc-729d136aa33d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 944 time: 0.0511150 Nov 08 16:13:19.783526 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 00b6d387-6249-49c0-81db-f2b5b8a1ce31 up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:13:19.794631 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-81ba0e52-ae0d-45cf-ac5f-820570e9c731 req-23086f0d-134f-4cea-9a46-20f37838be34 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423110 Nov 08 16:13:19.836463 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning for port 00b6d387-6249-49c0-81db-f2b5b8a1ce31 completed by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 16:13:19.840294 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port 00b6d387-6249-49c0-81db-f2b5b8a1ce31 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:13:19.840655 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:19.914911 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:19.936942 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2be55525-c510-4909-a898-370d4760deea', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '00b6d387-6249-49c0-81db-f2b5b8a1ce31'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:13:19.939162 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-658d8875-162b-43c5-bacd-0dfe5b89d40a" -d '{"events": [{"server_uuid": "2be55525-c510-4909-a898-370d4760deea", "name": "network-vif-plugged", "status": "completed", "tag": "00b6d387-6249-49c0-81db-f2b5b8a1ce31"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:13:19.951864 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 00b6d387-6249-49c0-81db-f2b5b8a1ce31, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=00b6d387-6249-49c0-81db-f2b5b8a1ce31,segment=NetworkSegment(4d73fdfb-694f-4679-be5c-5e9ca8483c31),segment_id=4d73fdfb-694f-4679-be5c-5e9ca8483c31)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:13:19.955935 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:19.985178 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:13:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d13b64f9-b8ec-40b4-9985-17fe7054cd95 x-openstack-request-id: req-d13b64f9-b8ec-40b4-9985-17fe7054cd95 {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:13:19.985491 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2be55525-c510-4909-a898-370d4760deea", "name": "network-vif-plugged", "status": "completed", "tag": "00b6d387-6249-49c0-81db-f2b5b8a1ce31", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:13:19.985766 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-d13b64f9-b8ec-40b4-9985-17fe7054cd95 {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:13:19.986178 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2be55525-c510-4909-a898-370d4760deea', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '00b6d387-6249-49c0-81db-f2b5b8a1ce31', 'code': 200} Nov 08 16:13:20.008407 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=00b6d387-6249-49c0-81db-f2b5b8a1ce31,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:20.171633 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e638f47-3354-47e9-bc02-21d1d12377d6 req-b56bbd6e-421f-4c19-b7fe-2a45a8d0f06f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:20.172957 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-3e638f47-3354-47e9-bc02-21d1d12377d6 req-b56bbd6e-421f-4c19-b7fe-2a45a8d0f06f service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=2be55525-c510-4909-a898-370d4760deea HTTP/1.1" status: 200 len: 1098 time: 0.0378585 Nov 08 16:13:20.229435 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-3e638f47-3354-47e9-bc02-21d1d12377d6 req-12f5ef36-68f6-4de6-8da1-68b8ec2f2196 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399451 Nov 08 16:13:20.380997 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-536a1bcd-fab1-4d83-9c3d-3138e4a421f8 req-6c9e2cf9-79a0-438b-b46b-e17fe08d5d78 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:20.382472 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-536a1bcd-fab1-4d83-9c3d-3138e4a421f8 req-6c9e2cf9-79a0-438b-b46b-e17fe08d5d78 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=2be55525-c510-4909-a898-370d4760deea HTTP/1.1" status: 200 len: 945 time: 0.0472617 Nov 08 16:13:20.428401 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-536a1bcd-fab1-4d83-9c3d-3138e4a421f8 req-eae21f7a-f668-45f5-8a9d-07380810ef8c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400565 Nov 08 16:13:20.540785 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f00f000-3197-4d53-9538-7653b7663a1b req-d816380e-ec98-4a9b-9aa4-c887c01cca1d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:20.542253 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4f00f000-3197-4d53-9538-7653b7663a1b req-d816380e-ec98-4a9b-9aa4-c887c01cca1d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0504289 Nov 08 16:13:20.588163 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4f00f000-3197-4d53-9538-7653b7663a1b req-42ca2688-1cb2-4fcf-ab8c-a164f3e819e1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401690 Nov 08 16:13:20.826323 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7ea033a-9143-435d-9ff7-b0eaa9ea9efc req-94a7622c-7c17-4d45-82fa-ef86d9de8edc tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:20.827834 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f7ea033a-9143-435d-9ff7-b0eaa9ea9efc req-94a7622c-7c17-4d45-82fa-ef86d9de8edc tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 944 time: 0.0486705 Nov 08 16:13:20.883023 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f7ea033a-9143-435d-9ff7-b0eaa9ea9efc req-c439bf2e-dd8e-447a-bbfa-5ff28d8ced72 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495584 Nov 08 16:13:20.920779 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dea3970-4e0d-4085-b281-b5630c10116a req-23d6c75b-7028-4236-ab79-50c1b07a89be tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:20.922256 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6dea3970-4e0d-4085-b281-b5630c10116a req-23d6c75b-7028-4236-ab79-50c1b07a89be tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 944 time: 0.0527427 Nov 08 16:13:20.970076 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6dea3970-4e0d-4085-b281-b5630c10116a req-0a42fffa-535e-4388-a465-6dca3882671b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419538 Nov 08 16:13:21.540789 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf71da23-856a-40f7-9066-43f44aac047d req-37690534-5dd4-4bfa-b685-7ed15af436d9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:21.542295 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cf71da23-856a-40f7-9066-43f44aac047d req-37690534-5dd4-4bfa-b685-7ed15af436d9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=2be55525-c510-4909-a898-370d4760deea HTTP/1.1" status: 200 len: 945 time: 0.0484025 Nov 08 16:13:21.592632 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cf71da23-856a-40f7-9066-43f44aac047d req-fd8a6ae6-57eb-458a-9ef9-7647ee4a12b2 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427485 Nov 08 16:13:21.705096 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26263f50-164a-4024-b9e7-b3d010416e21 req-e745d540-3076-4b30-9a35-f16498d382e6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:21.706576 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-26263f50-164a-4024-b9e7-b3d010416e21 req-e745d540-3076-4b30-9a35-f16498d382e6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0474126 Nov 08 16:13:21.755219 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-26263f50-164a-4024-b9e7-b3d010416e21 req-f22b6e3b-554b-4684-af2b-7b09685787df tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426996 Nov 08 16:13:21.781529 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 69152346-0cf4-4b0a-9db9-f1bddb32dc4b up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:13:21.834734 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning for port 69152346-0cf4-4b0a-9db9-f1bddb32dc4b completed by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 16:13:21.838314 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port 69152346-0cf4-4b0a-9db9-f1bddb32dc4b triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:13:21.838674 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:21.912092 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:21.945425 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 69152346-0cf4-4b0a-9db9-f1bddb32dc4b, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=69152346-0cf4-4b0a-9db9-f1bddb32dc4b,segment=NetworkSegment(d89c6b3f-ecc6-4296-92e8-9f4a30c70af3),segment_id=d89c6b3f-ecc6-4296-92e8-9f4a30c70af3)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:13:21.949534 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:21.987475 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e41a90ba-f4f1-472e-9883-150d31bcc777', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '69152346-0cf4-4b0a-9db9-f1bddb32dc4b'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:13:21.989677 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9c45b4b9-81e6-4c9f-9902-1f38a50cb148" -d '{"events": [{"server_uuid": "e41a90ba-f4f1-472e-9883-150d31bcc777", "name": "network-vif-plugged", "status": "completed", "tag": "69152346-0cf4-4b0a-9db9-f1bddb32dc4b"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:13:22.004225 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bca65e49-7a53-4dbc-b73f-2ce61451ce00 req-1b537c39-9f3f-47ca-95c1-feb16e3b5b88 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:22.005401 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=69152346-0cf4-4b0a-9db9-f1bddb32dc4b,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:22.005896 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bca65e49-7a53-4dbc-b73f-2ce61451ce00 req-1b537c39-9f3f-47ca-95c1-feb16e3b5b88 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 945 time: 0.0524669 Nov 08 16:13:22.062883 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bca65e49-7a53-4dbc-b73f-2ce61451ce00 req-727a3710-165d-4c5d-a40c-f30fdfbf528c tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504372 Nov 08 16:13:22.099436 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1dd8db1-f5f8-46fb-8c2b-86d998461ad5 req-6da3bf93-3f3e-4f0a-9433-17b2640d7431 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:22.101448 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d1dd8db1-f5f8-46fb-8c2b-86d998461ad5 req-6da3bf93-3f3e-4f0a-9433-17b2640d7431 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 944 time: 0.0521090 Nov 08 16:13:22.109682 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:13:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fa6e5d83-1711-44f5-a0f9-73c227226655 x-openstack-request-id: req-fa6e5d83-1711-44f5-a0f9-73c227226655 {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:13:22.109682 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e41a90ba-f4f1-472e-9883-150d31bcc777", "name": "network-vif-plugged", "status": "completed", "tag": "69152346-0cf4-4b0a-9db9-f1bddb32dc4b", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:13:22.109682 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-fa6e5d83-1711-44f5-a0f9-73c227226655 {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:13:22.109682 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e41a90ba-f4f1-472e-9883-150d31bcc777', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '69152346-0cf4-4b0a-9db9-f1bddb32dc4b', 'code': 200} Nov 08 16:13:22.153972 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d1dd8db1-f5f8-46fb-8c2b-86d998461ad5 req-4e061779-4208-4c67-b356-e72157759ac1 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452890 Nov 08 16:13:22.461556 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-d34d8d24-b601-4623-bb5b-720741720721 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:22.462980 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-d34d8d24-b601-4623-bb5b-720741720721 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/networks?id=f70ee550-62a6-48db-bca5-a0b964bbcce9 HTTP/1.1" status: 200 len: 815 time: 0.1070669 Nov 08 16:13:22.478124 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-82eaa557-5f34-4b3b-b464-6129ca9fee11 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/quotas/549e9715f7424ff5b3b252f354adafe9 HTTP/1.1" status: 200 len: 375 time: 0.0091932 Nov 08 16:13:22.508794 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6d177c4-0709-41e7-bb4a-a8b6f98bb70a req-f59981a6-ce29-46a8-80a8-52bb662658ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:22.510323 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-e6d177c4-0709-41e7-bb4a-a8b6f98bb70a req-f59981a6-ce29-46a8-80a8-52bb662658ed service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 1098 time: 0.2529755 Nov 08 16:13:22.534956 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-c9a25a75-9785-4975-b9da-c5d9d810320c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?tenant_id=549e9715f7424ff5b3b252f354adafe9&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0512366 Nov 08 16:13:22.561021 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-e6d177c4-0709-41e7-bb4a-a8b6f98bb70a req-0c860bb2-a896-4910-a856-dd4f09753255 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0370140 Nov 08 16:13:22.632092 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-f4fa81c2-8db0-4533-8167-fbfcd87e8eaf service neutron] 10.222.0.37 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0886970 Nov 08 16:13:22.755464 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05bb08f9-1d16-4523-b5ee-40d373ad11a0 req-a302e6b1-3557-49a4-a0ba-2e067972a5d0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:22.757388 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-05bb08f9-1d16-4523-b5ee-40d373ad11a0 req-a302e6b1-3557-49a4-a0ba-2e067972a5d0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=2be55525-c510-4909-a898-370d4760deea HTTP/1.1" status: 200 len: 945 time: 0.0793786 Nov 08 16:13:22.759538 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-2f3b6e4f-17c0-433b-8bf0-94a2167e534e service neutron] 10.222.0.37 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1214807 Nov 08 16:13:22.806200 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-05bb08f9-1d16-4523-b5ee-40d373ad11a0 req-4a884639-ded4-4305-b871-1d8571a1d750 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426850 Nov 08 16:13:22.915833 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5efc5edf-47a8-432d-a836-95eb007f1943 req-655b81d5-4d1e-4eca-acf8-a02bace4ac40 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:22.917372 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5efc5edf-47a8-432d-a836-95eb007f1943 req-655b81d5-4d1e-4eca-acf8-a02bace4ac40 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0562615 Nov 08 16:13:22.966153 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5efc5edf-47a8-432d-a836-95eb007f1943 req-e00533c3-eebe-4067-bccd-6e92361d5ef2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427268 Nov 08 16:13:23.060361 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b1d51e85-9dd3-4c36-8f16-f91f56f4225e req-99f52eb2-3ba4-47eb-9e64-b6a2ff9f1b03 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 210 time: 0.0299218 Nov 08 16:13:23.187139 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3ec56a2-2a09-46ef-a059-e217af2b5d7f req-89e0b26b-9c4e-4cf2-a75c-cff9eb5470cf tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:23.190282 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f3ec56a2-2a09-46ef-a059-e217af2b5d7f req-89e0b26b-9c4e-4cf2-a75c-cff9eb5470cf tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 945 time: 0.0555139 Nov 08 16:13:23.247748 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f3ec56a2-2a09-46ef-a059-e217af2b5d7f req-1eb0d118-d83b-470d-81fb-0e190997a18c tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0531149 Nov 08 16:13:23.285730 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d027fcb-b4a0-45ff-96cd-4fc407f7cd00 req-c65e969c-dc4f-4a32-9ec0-3c76267093a4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:23.287761 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9d027fcb-b4a0-45ff-96cd-4fc407f7cd00 req-c65e969c-dc4f-4a32-9ec0-3c76267093a4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 944 time: 0.0555151 Nov 08 16:13:23.336348 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9d027fcb-b4a0-45ff-96cd-4fc407f7cd00 req-72a1ad43-66f7-4a73-b52d-01c84b12b891 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427921 Nov 08 16:13:23.918384 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c58216e2-55e9-492e-bfa3-f000a9570d97 req-922ae022-a760-48b4-a315-4ae71d660725 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:23.919839 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c58216e2-55e9-492e-bfa3-f000a9570d97 req-922ae022-a760-48b4-a315-4ae71d660725 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=2be55525-c510-4909-a898-370d4760deea HTTP/1.1" status: 200 len: 945 time: 0.0472820 Nov 08 16:13:23.968979 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c58216e2-55e9-492e-bfa3-f000a9570d97 req-3d44138a-fcb9-4734-b2b2-e276b317ffd9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432501 Nov 08 16:13:24.099066 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d88cc98-b3ff-49c7-8503-1e51e191e9c7 req-06b80a35-1ce1-46cd-803d-1ebeb588ab92 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:24.101126 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7d88cc98-b3ff-49c7-8503-1e51e191e9c7 req-06b80a35-1ce1-46cd-803d-1ebeb588ab92 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0493994 Nov 08 16:13:24.149144 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7d88cc98-b3ff-49c7-8503-1e51e191e9c7 req-23268292-44fa-46ea-aafe-a019d2a587ba tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421348 Nov 08 16:13:24.203613 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b19ce623-072e-4710-be91-36a994726dac req-b46da959-851b-4cce-bdad-4e2926418be9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 210 time: 0.0311666 Nov 08 16:13:24.406188 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ecc27ab-6613-4474-84ed-a6594e50510f req-e271a1f4-7edb-4738-a2d8-e152c883d0b3 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:24.408008 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5ecc27ab-6613-4474-84ed-a6594e50510f req-e271a1f4-7edb-4738-a2d8-e152c883d0b3 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 945 time: 0.0644765 Nov 08 16:13:24.415403 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-caf79006-e8cd-4596-a636-8e29a291390c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:24.417109 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-caf79006-e8cd-4596-a636-8e29a291390c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.25 "GET /v2.0/networks?id=f70ee550-62a6-48db-bca5-a0b964bbcce9 HTTP/1.1" status: 200 len: 815 time: 0.1506050 Nov 08 16:13:24.435562 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Request body: {'port': {'device_id': 'cf462447-a55a-46b8-9afd-afca942aa011', 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9', 'admin_state_up': True, 'tenant_id': '549e9715f7424ff5b3b252f354adafe9'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:13:24.468306 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5ecc27ab-6613-4474-84ed-a6594e50510f req-27509955-5764-4672-8fe1-1b946b8d3e6b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0539775 Nov 08 16:13:24.531286 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dba1982e-747a-4a75-b4f1-75a4c9a63349 req-14784391-a9f3-454d-a1e6-051b6cded5cc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:24.532860 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dba1982e-747a-4a75-b4f1-75a4c9a63349 req-14784391-a9f3-454d-a1e6-051b6cded5cc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 944 time: 0.0634537 Nov 08 16:13:24.589312 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Made reservation on behalf of 549e9715f7424ff5b3b252f354adafe9 for: {'port': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:13:24.592786 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:24.615621 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dba1982e-747a-4a75-b4f1-75a4c9a63349 req-8e7a3124-08fe-48ec-8fb0-06433a7d6f35 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0681880 Nov 08 16:13:24.719735 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_common [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Allocated IP 172.20.0.9 (f70ee550-62a6-48db-bca5-a0b964bbcce9/cd23e532-b366-42a0-82e4-ec7326cf3b48/f47160fc-9457-4c27-a7dc-b4b4b112f9b1) {{(pid=101245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:13:24.843583 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e3ac938-d460-471c-9640-216b940e23fd req-0e17294e-cbe4-4816-9353-f7990d8315d3 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:24.844978 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5e3ac938-d460-471c-9640-216b940e23fd req-0e17294e-cbe4-4816-9353-f7990d8315d3 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=2be55525-c510-4909-a898-370d4760deea HTTP/1.1" status: 200 len: 945 time: 0.0501604 Nov 08 16:13:24.864383 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks [] for port, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:24.891595 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5e3ac938-d460-471c-9640-216b940e23fd req-e217d4f3-27e4-46ef-8f2c-3b29ef96aaaa tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404615 Nov 08 16:13:24.897600 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:24.942688 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Network f70ee550-62a6-48db-bca5-a0b964bbcce9 is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:13:24.948085 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:13:24.951756 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Received port after_create {{(pid=101245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:13:24.957820 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Pushing event updated for resources: {'Port': ['ID=f47160fc-9457-4c27-a7dc-b4b4b112f9b1,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:24.983465 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:24.983806 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:24.984141 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:24.984469 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:24.984793 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:24.985116 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:24.985433 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:24.985776 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:24.986098 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:24.986414 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:24.986727 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:24.987039 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:25.011800 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:25.012402 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for port, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:25.028019 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-b69c023c-0afe-4905-9364-db5221f873c4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5969892 Nov 08 16:13:25.070063 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['4020a644-ef2e-4dd8-931a-cfccef4e7b15', 'd14efac8-b33a-4eb0-b610-32a9bf41b972', 'b2d31fb8-0a87-4aea-8200-914cd468d395'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:13:25.095684 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-975b8829-f4f1-4374-987c-3486c95a6bbf service neutron] Request body: {'port': {'device_id': 'cf462447-a55a-46b8-9afd-afca942aa011', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81618'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:13:25.150997 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-975b8829-f4f1-4374-987c-3486c95a6bbf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:25.344296 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfb1a1f3-8f82-4be9-9391-0bea88099785 req-43fe4795-d0be-423c-a368-eafc19f22a2d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:25.346201 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dfb1a1f3-8f82-4be9-9391-0bea88099785 req-43fe4795-d0be-423c-a368-eafc19f22a2d tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 931 time: 0.0595422 Nov 08 16:13:25.397251 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dfb1a1f3-8f82-4be9-9391-0bea88099785 req-56eabef9-31e5-41d0-87c8-f7b2e2efca48 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441365 Nov 08 16:13:25.428825 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.notifiers.nova [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-975b8829-f4f1-4374-987c-3486c95a6bbf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f47160fc-9457-4c27-a7dc-b4b4b112f9b1 {{(pid=101245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:13:25.436229 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-975b8829-f4f1-4374-987c-3486c95a6bbf service neutron] Publish callbacks [] for port, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:25.447629 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.provisioning_blocks [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-975b8829-f4f1-4374-987c-3486c95a6bbf service neutron] Transition to ACTIVE for port object f47160fc-9457-4c27-a7dc-b4b4b112f9b1 will not be triggered until provisioned by entity L2. {{(pid=101245) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 16:13:25.451380 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-975b8829-f4f1-4374-987c-3486c95a6bbf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7464016'] for port, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:25.519136 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-975b8829-f4f1-4374-987c-3486c95a6bbf service neutron] Pushing event updated for resources: {'Port': ['ID=f47160fc-9457-4c27-a7dc-b4b4b112f9b1,revision_number=2']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:25.572383 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.managers [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-975b8829-f4f1-4374-987c-3486c95a6bbf service neutron] Attempting to bind port f47160fc-9457-4c27-a7dc-b4b4b112f9b1 on host hv-cinder-81618 for vnic_type normal with profile {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:13:25.572712 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.managers [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-975b8829-f4f1-4374-987c-3486c95a6bbf service neutron] Attempting to bind port f47160fc-9457-4c27-a7dc-b4b4b112f9b1 by drivers openvswitch,hyperv on host hv-cinder-81618 at level 0 using segments [{'id': 'fab7ad78-c438-48e7-8fdb-80ff50b8600c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9'}] {{(pid=101245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:13:25.573036 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-975b8829-f4f1-4374-987c-3486c95a6bbf service neutron] Attempting to bind port f47160fc-9457-4c27-a7dc-b4b4b112f9b1 on network f70ee550-62a6-48db-bca5-a0b964bbcce9 {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:13:25.577551 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-975b8829-f4f1-4374-987c-3486c95a6bbf service neutron] Port f47160fc-9457-4c27-a7dc-b4b4b112f9b1 on network f70ee550-62a6-48db-bca5-a0b964bbcce9 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81618 {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 16:13:25.577901 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-975b8829-f4f1-4374-987c-3486c95a6bbf service neutron] Attempting to bind port f47160fc-9457-4c27-a7dc-b4b4b112f9b1 on network f70ee550-62a6-48db-bca5-a0b964bbcce9 {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:13:25.582678 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-975b8829-f4f1-4374-987c-3486c95a6bbf service neutron] Checking agent: {'id': '54bf9779-c14d-412a-90fc-96b4a6589d5a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81618', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'started_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 13, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:13:25.583005 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-975b8829-f4f1-4374-987c-3486c95a6bbf service neutron] Checking segment: {'id': 'fab7ad78-c438-48e7-8fdb-80ff50b8600c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:13:25.583377 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-975b8829-f4f1-4374-987c-3486c95a6bbf service neutron] Bound using segment: {'id': 'fab7ad78-c438-48e7-8fdb-80ff50b8600c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9'} {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:13:25.583793 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.managers [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-975b8829-f4f1-4374-987c-3486c95a6bbf service neutron] Bound port: f47160fc-9457-4c27-a7dc-b4b4b112f9b1, host: hv-cinder-81618, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fab7ad78-c438-48e7-8fdb-80ff50b8600c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9'}}] {{(pid=101245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:13:25.584166 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-975b8829-f4f1-4374-987c-3486c95a6bbf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:25.589836 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2b4a038-d41b-4693-a48b-7f64d06e099f req-6686243a-b5d4-42e3-826a-630d463478a3 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:25.591330 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c2b4a038-d41b-4693-a48b-7f64d06e099f req-6686243a-b5d4-42e3-826a-630d463478a3 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 945 time: 0.0486801 Nov 08 16:13:25.638095 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c2b4a038-d41b-4693-a48b-7f64d06e099f req-40948762-acbf-4a5d-b1b4-8b29cdcfaab3 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406146 Nov 08 16:13:25.647226 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-975b8829-f4f1-4374-987c-3486c95a6bbf service neutron] For port f47160fc-9457-4c27-a7dc-b4b4b112f9b1, host hv-cinder-81618, cleared binding levels {{(pid=101245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:13:25.651690 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-975b8829-f4f1-4374-987c-3486c95a6bbf service neutron] For port f47160fc-9457-4c27-a7dc-b4b4b112f9b1, host hv-cinder-81618, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=f47160fc-9457-4c27-a7dc-b4b4b112f9b1,segment=NetworkSegment(fab7ad78-c438-48e7-8fdb-80ff50b8600c),segment_id=fab7ad78-c438-48e7-8fdb-80ff50b8600c)] {{(pid=101245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:13:25.656705 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-975b8829-f4f1-4374-987c-3486c95a6bbf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7464016'] for port, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:25.689452 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-975b8829-f4f1-4374-987c-3486c95a6bbf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:25.690328 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-975b8829-f4f1-4374-987c-3486c95a6bbf service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for port, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:25.691723 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-975b8829-f4f1-4374-987c-3486c95a6bbf service neutron] 10.222.0.25 "PUT /v2.0/ports/f47160fc-9457-4c27-a7dc-b4b4b112f9b1 HTTP/1.1" status: 200 len: 1093 time: 0.6004245 Nov 08 16:13:25.693900 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cf462447-a55a-46b8-9afd-afca942aa011', 'tag': 'f47160fc-9457-4c27-a7dc-b4b4b112f9b1'}] {{(pid=101245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:13:25.696115 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9303bddee447de525cefc409d3d14f9dbe8ef1f21bfe9eb24fdef2609d4aa3c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f6e6c8b4-c6d7-4b70-b37f-598c336dc8d6" -d '{"events": [{"name": "network-changed", "server_uuid": "cf462447-a55a-46b8-9afd-afca942aa011", "tag": "f47160fc-9457-4c27-a7dc-b4b4b112f9b1"}]}' {{(pid=101245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:13:25.725408 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-975b8829-f4f1-4374-987c-3486c95a6bbf service neutron] Pushing event updated for resources: {'Port': ['ID=f47160fc-9457-4c27-a7dc-b4b4b112f9b1,revision_number=3']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:25.752005 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:13:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c25aabcc-ad0b-447d-a551-5ab70bf261a8 x-openstack-request-id: req-c25aabcc-ad0b-447d-a551-5ab70bf261a8 {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:13:25.752293 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cf462447-a55a-46b8-9afd-afca942aa011", "tag": "f47160fc-9457-4c27-a7dc-b4b4b112f9b1", "status": "completed", "code": 200}]} {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:13:25.752584 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-c25aabcc-ad0b-447d-a551-5ab70bf261a8 {{(pid=101245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:13:25.752985 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cf462447-a55a-46b8-9afd-afca942aa011', 'tag': 'f47160fc-9457-4c27-a7dc-b4b4b112f9b1', 'status': 'completed', 'code': 200} Nov 08 16:13:25.765201 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-356fb2a7-bb85-4e84-b860-d24c39ab1309 req-37fbcc08-d16d-428f-a970-a31b8fb18aba tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:25.766711 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-356fb2a7-bb85-4e84-b860-d24c39ab1309 req-37fbcc08-d16d-428f-a970-a31b8fb18aba tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 944 time: 0.0748394 Nov 08 16:13:25.808383 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-7441128a-fc95-4a16-9cbc-6dccd0b5176a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:25.809887 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-7441128a-fc95-4a16-9cbc-6dccd0b5176a service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=549e9715f7424ff5b3b252f354adafe9&device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 1096 time: 0.0406818 Nov 08 16:13:25.815199 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-356fb2a7-bb85-4e84-b860-d24c39ab1309 req-23abcf0f-0094-429e-b93a-83bc47dfc633 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421064 Nov 08 16:13:25.874604 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-b71ba8fb-e72b-479c-b1b4-3205eb3c39bd service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=f47160fc-9457-4c27-a7dc-b4b4b112f9b1 HTTP/1.1" status: 200 len: 217 time: 0.0352287 Nov 08 16:13:25.932735 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-16f1bf40-c77e-42b5-8156-6c8185c22fc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:25.934197 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-16f1bf40-c77e-42b5-8156-6c8185c22fc0 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=cd23e532-b366-42a0-82e4-ec7326cf3b48 HTTP/1.1" status: 200 len: 855 time: 0.0424316 Nov 08 16:13:25.968666 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-2b56d83c-3397-48be-a630-394565baf4fe service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=f70ee550-62a6-48db-bca5-a0b964bbcce9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0239687 Nov 08 16:13:26.007193 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec6fa545-47e6-4afc-9ce2-bc6f1d4e8b75 req-8aee1488-09e4-477a-a943-c7399bd70f5c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:26.008789 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ec6fa545-47e6-4afc-9ce2-bc6f1d4e8b75 req-8aee1488-09e4-477a-a943-c7399bd70f5c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=2be55525-c510-4909-a898-370d4760deea HTTP/1.1" status: 200 len: 945 time: 0.0482457 Nov 08 16:13:26.055332 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ec6fa545-47e6-4afc-9ce2-bc6f1d4e8b75 req-874088da-b6f6-4a9e-b6a3-d5c9079532d3 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403659 Nov 08 16:13:26.065533 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-c784816d-00f9-4757-bbb0-d1dd74342be2 service neutron] 10.222.0.25 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844793 Nov 08 16:13:26.156405 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-43019220-cbe5-46ba-90db-518f6e7afbc4 req-c9f9580a-7f44-42b4-8c02-62666bbfa8d0 service neutron] 10.222.0.25 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0802629 Nov 08 16:13:26.285742 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6e6c8b4-c6d7-4b70-b37f-598c336dc8d6 req-2aefd43e-3459-4407-95d6-b2795a34dd7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:26.287259 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-f6e6c8b4-c6d7-4b70-b37f-598c336dc8d6 req-2aefd43e-3459-4407-95d6-b2795a34dd7c service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=549e9715f7424ff5b3b252f354adafe9&device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 1096 time: 0.0401835 Nov 08 16:13:26.385927 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6e6c8b4-c6d7-4b70-b37f-598c336dc8d6 req-058a3dad-71f1-4440-9c39-5d521ae64a22 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:26.387351 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-f6e6c8b4-c6d7-4b70-b37f-598c336dc8d6 req-058a3dad-71f1-4440-9c39-5d521ae64a22 service neutron] 10.222.0.25 "GET /v2.0/networks?id=f70ee550-62a6-48db-bca5-a0b964bbcce9 HTTP/1.1" status: 200 len: 916 time: 0.0858719 Nov 08 16:13:26.433860 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-f6e6c8b4-c6d7-4b70-b37f-598c336dc8d6 req-f5d97780-bbd2-4c29-846c-cb3f7b9c7443 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=f47160fc-9457-4c27-a7dc-b4b4b112f9b1 HTTP/1.1" status: 200 len: 217 time: 0.0327997 Nov 08 16:13:26.488789 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6e6c8b4-c6d7-4b70-b37f-598c336dc8d6 req-48c4e446-a121-4846-8dad-de00482d20b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:26.490928 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-f6e6c8b4-c6d7-4b70-b37f-598c336dc8d6 req-48c4e446-a121-4846-8dad-de00482d20b4 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=cd23e532-b366-42a0-82e4-ec7326cf3b48 HTTP/1.1" status: 200 len: 855 time: 0.0462182 Nov 08 16:13:26.509030 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f92f235-9d24-4d8a-a03a-0e73a2c81a0d req-7865de25-4a30-448a-8e29-4486da12f1f0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:26.510510 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4f92f235-9d24-4d8a-a03a-0e73a2c81a0d req-7865de25-4a30-448a-8e29-4486da12f1f0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 943 time: 0.0474193 Nov 08 16:13:26.530820 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-f6e6c8b4-c6d7-4b70-b37f-598c336dc8d6 req-b70896ec-9238-4cec-a2ae-9930538aac63 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=f70ee550-62a6-48db-bca5-a0b964bbcce9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0246334 Nov 08 16:13:26.559620 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4f92f235-9d24-4d8a-a03a-0e73a2c81a0d req-03b7db29-eadd-4725-8b1f-c88097e10322 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430944 Nov 08 16:13:26.929617 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-f6e6c8b4-c6d7-4b70-b37f-598c336dc8d6 req-e5d7cc5b-84bd-430a-b7e4-808452a4988e service neutron] 10.222.0.25 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0812836 Nov 08 16:13:27.031024 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-f6e6c8b4-c6d7-4b70-b37f-598c336dc8d6 req-2deaef2b-6feb-4048-9f99-256bd202ebbf service neutron] 10.222.0.25 "GET /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0824139 Nov 08 16:13:27.222979 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9684a89-c184-4791-ac4f-bf30715fea27 req-0e0a616b-4db3-462f-8b90-a3a8cd4ae0e2 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:27.225307 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f9684a89-c184-4791-ac4f-bf30715fea27 req-0e0a616b-4db3-462f-8b90-a3a8cd4ae0e2 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 945 time: 0.0493515 Nov 08 16:13:27.272049 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f9684a89-c184-4791-ac4f-bf30715fea27 req-e565ed71-b8c4-477c-aeb8-181b2d865a1d tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401323 Nov 08 16:13:27.373105 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c497c123-ddb0-43d6-91f9-c7c04e51d558 req-553cf43e-4b43-4ba8-a23c-5185033e7463 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:27.374489 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c497c123-ddb0-43d6-91f9-c7c04e51d558 req-553cf43e-4b43-4ba8-a23c-5185033e7463 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 944 time: 0.0468566 Nov 08 16:13:27.421005 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c497c123-ddb0-43d6-91f9-c7c04e51d558 req-82f41523-dfec-478c-8de0-9d7afbf3ef08 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407922 Nov 08 16:13:27.525090 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fae0db9-7531-48c8-982f-c7ce1df87a1c req-1964d731-3c60-4295-af08-8221e83301ac tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:27.526544 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1fae0db9-7531-48c8-982f-c7ce1df87a1c req-1964d731-3c60-4295-af08-8221e83301ac tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=2be55525-c510-4909-a898-370d4760deea HTTP/1.1" status: 200 len: 945 time: 0.0497689 Nov 08 16:13:27.571278 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1fae0db9-7531-48c8-982f-c7ce1df87a1c req-415d6890-aecf-4503-ac19-385bb511625c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389655 Nov 08 16:13:27.670074 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c90c2022-e1f6-4a07-bda5-c9b5cf787b1d req-c3b5f95a-6d7b-4006-8456-c5abeb06df3f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:27.671550 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c90c2022-e1f6-4a07-bda5-c9b5cf787b1d req-c3b5f95a-6d7b-4006-8456-c5abeb06df3f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 943 time: 0.0470138 Nov 08 16:13:27.716465 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c90c2022-e1f6-4a07-bda5-c9b5cf787b1d req-5e43676d-e287-421d-9cc4-38af24fe251c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394020 Nov 08 16:13:27.816452 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfb09d0d-7efc-4e98-a346-a5758eaa0d28 req-3aef9004-6957-4f9c-9817-016febb05960 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:27.817996 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bfb09d0d-7efc-4e98-a346-a5758eaa0d28 req-3aef9004-6957-4f9c-9817-016febb05960 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0489047 Nov 08 16:13:27.868482 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bfb09d0d-7efc-4e98-a346-a5758eaa0d28 req-78b0d76d-2ab8-4db0-bb7c-9107716373eb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444791 Nov 08 16:13:28.387806 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06439bd7-622d-4321-ab13-ccd1ccbbedce req-810401eb-2c52-453b-970d-85b5b281c91c tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:28.389246 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-06439bd7-622d-4321-ab13-ccd1ccbbedce req-810401eb-2c52-453b-970d-85b5b281c91c tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 945 time: 0.0478115 Nov 08 16:13:28.434555 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-06439bd7-622d-4321-ab13-ccd1ccbbedce req-53215289-13bd-4a17-8e91-0e92e971053f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394948 Nov 08 16:13:28.538538 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7202d515-f775-4e42-ae20-fd5419fe274d req-1c4b6ed1-24de-494e-964b-780364f66707 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:28.540231 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7202d515-f775-4e42-ae20-fd5419fe274d req-1c4b6ed1-24de-494e-964b-780364f66707 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 944 time: 0.0510726 Nov 08 16:13:28.590512 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7202d515-f775-4e42-ae20-fd5419fe274d req-035eeba6-eea2-4a41-b5f8-6c5879bcc5d5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446308 Nov 08 16:13:28.695557 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-080457e2-adf2-413f-8512-224d11fcb1e4 req-f80a660a-624f-47f8-a823-f38a0d7c8a07 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:28.696950 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-080457e2-adf2-413f-8512-224d11fcb1e4 req-f80a660a-624f-47f8-a823-f38a0d7c8a07 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=2be55525-c510-4909-a898-370d4760deea HTTP/1.1" status: 200 len: 945 time: 0.0535617 Nov 08 16:13:28.745689 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-080457e2-adf2-413f-8512-224d11fcb1e4 req-d5a9a10d-2977-4e74-82af-42676615e795 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426517 Nov 08 16:13:28.849855 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f903cf2d-5750-4194-8129-e83ceb16838e req-2e6c9fd4-673b-4d48-ba69-6029204d68d0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:28.851155 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f903cf2d-5750-4194-8129-e83ceb16838e req-2e6c9fd4-673b-4d48-ba69-6029204d68d0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 943 time: 0.0534377 Nov 08 16:13:28.903140 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f903cf2d-5750-4194-8129-e83ceb16838e req-c1464487-0a35-4f41-ba3d-7a90c3093b20 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444980 Nov 08 16:13:29.125513 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbb774a2-1a6e-4ba6-9c69-fd78b005f156 req-c5095dc9-c60f-4985-a6a0-0dfc9093f71f tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:29.127031 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-fbb774a2-1a6e-4ba6-9c69-fd78b005f156 req-c5095dc9-c60f-4985-a6a0-0dfc9093f71f tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.25 "GET /v2.0/ports?device_id=2be55525-c510-4909-a898-370d4760deea HTTP/1.1" status: 200 len: 945 time: 0.0789027 Nov 08 16:13:29.259471 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [req-fbb774a2-1a6e-4ba6-9c69-fd78b005f156 req-b119e567-e65c-4446-aecc-db94908233e5 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Deleting port 00b6d387-6249-49c0-81db-f2b5b8a1ce31 {{(pid=101245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:13:29.259804 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-fbb774a2-1a6e-4ba6-9c69-fd78b005f156 req-b119e567-e65c-4446-aecc-db94908233e5 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:29.350947 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [req-fbb774a2-1a6e-4ba6-9c69-fd78b005f156 req-b119e567-e65c-4446-aecc-db94908233e5 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] For port 00b6d387-6249-49c0-81db-f2b5b8a1ce31, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=00b6d387-6249-49c0-81db-f2b5b8a1ce31,segment=NetworkSegment(4d73fdfb-694f-4679-be5c-5e9ca8483c31),segment_id=4d73fdfb-694f-4679-be5c-5e9ca8483c31)] {{(pid=101245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:13:29.351300 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-fbb774a2-1a6e-4ba6-9c69-fd78b005f156 req-b119e567-e65c-4446-aecc-db94908233e5 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:29.365377 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [req-fbb774a2-1a6e-4ba6-9c69-fd78b005f156 req-b119e567-e65c-4446-aecc-db94908233e5 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling delete_port for 00b6d387-6249-49c0-81db-f2b5b8a1ce31 owned by compute:nova {{(pid=101245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:13:29.511812 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-fbb774a2-1a6e-4ba6-9c69-fd78b005f156 req-b119e567-e65c-4446-aecc-db94908233e5 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:29.524492 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['00b6d387-6249-49c0-81db-f2b5b8a1ce31'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:13:29.541199 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b119e567-e65c-4446-aecc-db94908233e5 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Pushing event deleted for resources: {'Port': ['ID=00b6d387-6249-49c0-81db-f2b5b8a1ce31,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:29.598988 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [req-fbb774a2-1a6e-4ba6-9c69-fd78b005f156 req-b119e567-e65c-4446-aecc-db94908233e5 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] No DVR routers for this DVR port 00b6d387-6249-49c0-81db-f2b5b8a1ce31 on host hv-cinder-81618 {{(pid=101245) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:13:29.602534 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-fbb774a2-1a6e-4ba6-9c69-fd78b005f156 req-b119e567-e65c-4446-aecc-db94908233e5 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:29.605881 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-fbb774a2-1a6e-4ba6-9c69-fd78b005f156 req-b119e567-e65c-4446-aecc-db94908233e5 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.25 "DELETE /v2.0/ports/00b6d387-6249-49c0-81db-f2b5b8a1ce31 HTTP/1.1" status: 204 len: 173 time: 0.4692061 Nov 08 16:13:29.606320 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2be55525-c510-4909-a898-370d4760deea', 'name': 'network-vif-deleted', 'tag': '00b6d387-6249-49c0-81db-f2b5b8a1ce31'}] {{(pid=101245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:13:29.608533 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9303bddee447de525cefc409d3d14f9dbe8ef1f21bfe9eb24fdef2609d4aa3c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2306b0f2-07b6-46f5-8369-f64bf9291c49" -d '{"events": [{"server_uuid": "2be55525-c510-4909-a898-370d4760deea", "name": "network-vif-deleted", "tag": "00b6d387-6249-49c0-81db-f2b5b8a1ce31"}]}' {{(pid=101245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:13:29.650408 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:13:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5125f327-c29f-4a7b-ae3c-dec2a7af8abd x-openstack-request-id: req-5125f327-c29f-4a7b-ae3c-dec2a7af8abd {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:13:29.650856 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2be55525-c510-4909-a898-370d4760deea", "name": "network-vif-deleted", "tag": "00b6d387-6249-49c0-81db-f2b5b8a1ce31", "status": "completed", "code": 200}]} {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:13:29.651148 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-5125f327-c29f-4a7b-ae3c-dec2a7af8abd {{(pid=101245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:13:29.651549 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2be55525-c510-4909-a898-370d4760deea', 'name': 'network-vif-deleted', 'tag': '00b6d387-6249-49c0-81db-f2b5b8a1ce31', 'status': 'completed', 'code': 200} Nov 08 16:13:29.748630 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5da75b94-84e7-4499-9a97-cb6a4e00a3fb req-4f8ae279-09fa-445f-9903-8323144136bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:29.750140 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5da75b94-84e7-4499-9a97-cb6a4e00a3fb req-4f8ae279-09fa-445f-9903-8323144136bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 944 time: 0.0545640 Nov 08 16:13:29.803613 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5da75b94-84e7-4499-9a97-cb6a4e00a3fb req-1375e826-7bc0-490d-9316-9e118ad9f9d1 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0472987 Nov 08 16:13:29.899176 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-df935bb9-953b-44e8-b52c-33a0250ff4c0 req-2d47ae43-f55e-4349-adc6-ebef4f9de1ef tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=2be55525-c510-4909-a898-370d4760deea HTTP/1.1" status: 200 len: 210 time: 0.0268335 Nov 08 16:13:30.022353 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f541534c-55a5-402e-8f8d-1a36381d9aa3 req-1548302f-ffcd-456e-a37b-2b8bcede4cb9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:30.023803 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f541534c-55a5-402e-8f8d-1a36381d9aa3 req-1548302f-ffcd-456e-a37b-2b8bcede4cb9 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 943 time: 0.0490601 Nov 08 16:13:30.069395 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f541534c-55a5-402e-8f8d-1a36381d9aa3 req-a4bfa968-868c-40c8-b272-e757a60d3bac tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397961 Nov 08 16:13:30.921641 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-413c91ad-85f8-46c2-ba70-b7a4e2860233 req-d49ca4a9-c1f6-41b3-af76-067618f26473 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:30.923270 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-413c91ad-85f8-46c2-ba70-b7a4e2860233 req-d49ca4a9-c1f6-41b3-af76-067618f26473 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 944 time: 0.0520310 Nov 08 16:13:30.989277 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-413c91ad-85f8-46c2-ba70-b7a4e2860233 req-a12a8306-10b8-481e-a390-a961acc3f295 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0588114 Nov 08 16:13:31.249572 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e96ce68f-86a6-447c-b8e7-e611c803107e req-f62cf99b-e435-4389-9500-841515582583 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:31.251047 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e96ce68f-86a6-447c-b8e7-e611c803107e req-f62cf99b-e435-4389-9500-841515582583 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 943 time: 0.1144826 Nov 08 16:13:31.284746 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-a37ae224-5052-4799-a9bd-2c41b6d22038 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:31.286163 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-a37ae224-5052-4799-a9bd-2c41b6d22038 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/networks?id=e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e HTTP/1.1" status: 200 len: 809 time: 0.1409848 Nov 08 16:13:31.314766 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-bc602afe-d16d-4dd1-9e35-52e8b4651e4a tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/quotas/9580ccbb790e4dff94da99ac8b1c98d5 HTTP/1.1" status: 200 len: 375 time: 0.0209603 Nov 08 16:13:31.322339 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e96ce68f-86a6-447c-b8e7-e611c803107e req-e14af4e8-9d39-477d-b710-6f90732f4ccd tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0622573 Nov 08 16:13:31.348480 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-9d2307b5-6453-4b04-b120-a7c6c81a9079 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?tenant_id=9580ccbb790e4dff94da99ac8b1c98d5&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0249321 Nov 08 16:13:31.446308 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-e9fb74ac-a6cb-4d54-b07d-d9a8f6a6024a service neutron] 10.222.0.37 "GET /v2.0/networks/e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0884347 Nov 08 16:13:31.535933 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-43f3dfff-0d2b-4a95-9ef2-9d0d7973a1a6 service neutron] 10.222.0.37 "GET /v2.0/networks/e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0844219 Nov 08 16:13:31.694480 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-27b4e002-118c-48e7-a725-1677193c5a72 req-fd07b512-56c1-4107-9da2-c895d178185d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 210 time: 0.0276058 Nov 08 16:13:31.836153 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 17d7004d-111e-4cfc-904c-a17ed005bc2f details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:13:31.929546 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 17d7004d-111e-4cfc-904c-a17ed005bc2f, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=17d7004d-111e-4cfc-904c-a17ed005bc2f,segment=NetworkSegment(1383b9f8-d178-4a90-828c-184fa1886253),segment_id=1383b9f8-d178-4a90-828c-184fa1886253)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:13:31.941111 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': '17d7004d-111e-4cfc-904c-a17ed005bc2f', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'port_id': '17d7004d-111e-4cfc-904c-a17ed005bc2f', 'mac_address': 'fa:16:3e:f2:d2:cd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 161, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:13:32.137907 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:32.150845 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 17d7004d-111e-4cfc-904c-a17ed005bc2f {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:13:32.153361 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-397d9957-9b99-418a-b1fc-a2a4941b427f req-254c705f-2448-45bd-9d2e-85bbad85e48c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:32.155136 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-397d9957-9b99-418a-b1fc-a2a4941b427f req-254c705f-2448-45bd-9d2e-85bbad85e48c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 944 time: 0.0558026 Nov 08 16:13:32.172447 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 17d7004d-111e-4cfc-904c-a17ed005bc2f, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=17d7004d-111e-4cfc-904c-a17ed005bc2f,segment=NetworkSegment(1383b9f8-d178-4a90-828c-184fa1886253),segment_id=1383b9f8-d178-4a90-828c-184fa1886253)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:13:32.177156 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:32.223033 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-397d9957-9b99-418a-b1fc-a2a4941b427f req-2783cbdc-b8d9-4afa-9301-e8ccab94c187 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0615358 Nov 08 16:13:32.225976 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=17d7004d-111e-4cfc-904c-a17ed005bc2f,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:32.436712 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fc5e5c4-842e-414f-88cf-3919789ee1ad req-aafeb9b2-7732-4eda-9a84-160cd50cad00 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:32.438204 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9fc5e5c4-842e-414f-88cf-3919789ee1ad req-aafeb9b2-7732-4eda-9a84-160cd50cad00 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 943 time: 0.0478103 Nov 08 16:13:32.485259 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9fc5e5c4-842e-414f-88cf-3919789ee1ad req-86303d5a-09ce-4c30-bf59-11ba4aee4765 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385852 Nov 08 16:13:32.777376 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-ce2bbc32-17a0-4612-b502-fa8fa5406a60 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:32.778874 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-ce2bbc32-17a0-4612-b502-fa8fa5406a60 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.25 "GET /v2.0/networks?id=e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e HTTP/1.1" status: 200 len: 809 time: 0.1036382 Nov 08 16:13:32.792636 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-492c7b1c-ae3a-451a-8892-f45b2b718f11 req-e837b75f-9af0-4374-ab96-58a15d1c61c1 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 210 time: 0.0265088 Nov 08 16:13:32.808839 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-4d6ff707-2256-4143-ac16-e125cb9e047d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Request body: {'port': {'device_id': '37e5636f-2ecf-4438-8be2-e973029678a1', 'network_id': 'e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e', 'admin_state_up': True, 'tenant_id': '9580ccbb790e4dff94da99ac8b1c98d5'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:13:32.919762 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-4d6ff707-2256-4143-ac16-e125cb9e047d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Made reservation on behalf of 9580ccbb790e4dff94da99ac8b1c98d5 for: {'port': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:13:32.919982 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['17d7004d-111e-4cfc-904c-a17ed005bc2f'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:13:32.923317 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-4d6ff707-2256-4143-ac16-e125cb9e047d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:33.042951 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_common [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-4d6ff707-2256-4143-ac16-e125cb9e047d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Allocated IP 172.20.0.10 (e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e/d10afa0f-2bc3-4957-b3e4-84967992ae54/2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e) {{(pid=101245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:13:33.212316 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-4d6ff707-2256-4143-ac16-e125cb9e047d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Publish callbacks [] for port, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:33.245276 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-4d6ff707-2256-4143-ac16-e125cb9e047d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:33.286405 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-4d6ff707-2256-4143-ac16-e125cb9e047d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Network e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:13:33.294428 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-4d6ff707-2256-4143-ac16-e125cb9e047d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:13:33.296877 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-4d6ff707-2256-4143-ac16-e125cb9e047d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Received port after_create {{(pid=101245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:13:33.330171 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d6ff707-2256-4143-ac16-e125cb9e047d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Pushing event updated for resources: {'Port': ['ID=2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:33.344061 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b43c86b9-3c40-42d6-acb2-80edc6a659d9 req-57bf1903-ce6e-4832-9fa2-a930d1e91f18 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:33.345630 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b43c86b9-3c40-42d6-acb2-80edc6a659d9 req-57bf1903-ce6e-4832-9fa2-a930d1e91f18 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 945 time: 0.0470226 Nov 08 16:13:33.355182 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-4d6ff707-2256-4143-ac16-e125cb9e047d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:33.355787 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-4d6ff707-2256-4143-ac16-e125cb9e047d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:33.372749 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-4d6ff707-2256-4143-ac16-e125cb9e047d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5702286 Nov 08 16:13:33.387020 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-d5643c86-a0e9-482c-bbc5-015a606fb653 service neutron] Request body: {'port': {'device_id': '37e5636f-2ecf-4438-8be2-e973029678a1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81618'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:13:33.400199 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b43c86b9-3c40-42d6-acb2-80edc6a659d9 req-1c0a5ed6-289f-4dde-82ba-5e16ac953d03 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0459964 Nov 08 16:13:33.439638 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-d5643c86-a0e9-482c-bbc5-015a606fb653 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:33.608852 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4c26cf7-4021-4c3d-9c8f-7f7feb658da6 req-0b2f9692-c973-4455-bae0-d91c45d70dc1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:33.611634 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f4c26cf7-4021-4c3d-9c8f-7f7feb658da6 req-0b2f9692-c973-4455-bae0-d91c45d70dc1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 943 time: 0.0509090 Nov 08 16:13:33.662937 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f4c26cf7-4021-4c3d-9c8f-7f7feb658da6 req-60f35d53-07d3-4d3b-80d3-537d3f0e5009 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464184 Nov 08 16:13:33.701733 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.notifiers.nova [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-d5643c86-a0e9-482c-bbc5-015a606fb653 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e {{(pid=101245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:13:33.708970 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-d5643c86-a0e9-482c-bbc5-015a606fb653 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:33.721191 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.provisioning_blocks [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-d5643c86-a0e9-482c-bbc5-015a606fb653 service neutron] Transition to ACTIVE for port object 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e will not be triggered until provisioned by entity L2. {{(pid=101245) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 16:13:33.724547 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-d5643c86-a0e9-482c-bbc5-015a606fb653 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7464016'] for port, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:33.773894 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5643c86-a0e9-482c-bbc5-015a606fb653 service neutron] Pushing event updated for resources: {'Port': ['ID=2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e,revision_number=2']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:33.841654 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device f47160fc-9457-4c27-a7dc-b4b4b112f9b1 details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:13:33.844692 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.managers [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-d5643c86-a0e9-482c-bbc5-015a606fb653 service neutron] Attempting to bind port 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e on host hv-cinder-81618 for vnic_type normal with profile {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:13:33.845218 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.managers [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-d5643c86-a0e9-482c-bbc5-015a606fb653 service neutron] Attempting to bind port 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e by drivers openvswitch,hyperv on host hv-cinder-81618 at level 0 using segments [{'id': '4d73fdfb-694f-4679-be5c-5e9ca8483c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 189, 'network_id': 'e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e'}] {{(pid=101245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:13:33.845310 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-d5643c86-a0e9-482c-bbc5-015a606fb653 service neutron] Attempting to bind port 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e on network e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:13:33.849620 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-d5643c86-a0e9-482c-bbc5-015a606fb653 service neutron] Port 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e on network e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81618 {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 16:13:33.849969 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-d5643c86-a0e9-482c-bbc5-015a606fb653 service neutron] Attempting to bind port 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e on network e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:13:33.852156 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 00b6d387-6249-49c0-81db-f2b5b8a1ce31 no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:13:33.855572 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-d5643c86-a0e9-482c-bbc5-015a606fb653 service neutron] Checking agent: {'id': '54bf9779-c14d-412a-90fc-96b4a6589d5a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81618', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'started_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 13, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:13:33.855899 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-d5643c86-a0e9-482c-bbc5-015a606fb653 service neutron] Checking segment: {'id': '4d73fdfb-694f-4679-be5c-5e9ca8483c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 189, 'network_id': 'e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:13:33.856491 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-d5643c86-a0e9-482c-bbc5-015a606fb653 service neutron] Bound using segment: {'id': '4d73fdfb-694f-4679-be5c-5e9ca8483c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 189, 'network_id': 'e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e'} {{(pid=101245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:13:33.859422 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.managers [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-d5643c86-a0e9-482c-bbc5-015a606fb653 service neutron] Bound port: 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e, host: hv-cinder-81618, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4d73fdfb-694f-4679-be5c-5e9ca8483c31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 189, 'network_id': 'e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e'}}] {{(pid=101245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:13:33.859422 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-d5643c86-a0e9-482c-bbc5-015a606fb653 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:33.877942 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] No Port match for: 00b6d387-6249-49c0-81db-f2b5b8a1ce31 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:13:33.878529 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 00b6d387-6249-49c0-81db-f2b5b8a1ce31 not bound to the agent host hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:13:33.909243 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1faf18a0-535b-4d68-9211-db331123b29c req-a1d25887-005e-4cb5-928a-1f93f45f290d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:33.910830 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1faf18a0-535b-4d68-9211-db331123b29c req-a1d25887-005e-4cb5-928a-1f93f45f290d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 944 time: 0.0488007 Nov 08 16:13:33.938503 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-d5643c86-a0e9-482c-bbc5-015a606fb653 service neutron] For port 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e, host hv-cinder-81618, cleared binding levels {{(pid=101245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:13:33.944506 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-d5643c86-a0e9-482c-bbc5-015a606fb653 service neutron] For port 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e, host hv-cinder-81618, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e,segment=NetworkSegment(4d73fdfb-694f-4679-be5c-5e9ca8483c31),segment_id=4d73fdfb-694f-4679-be5c-5e9ca8483c31)] {{(pid=101245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:13:33.949353 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-d5643c86-a0e9-482c-bbc5-015a606fb653 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7464016'] for port, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:33.960363 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1faf18a0-535b-4d68-9211-db331123b29c req-ee6a0dd5-1b55-4e30-ae50-051d73f82c13 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430162 Nov 08 16:13:33.976303 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port f47160fc-9457-4c27-a7dc-b4b4b112f9b1, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=f47160fc-9457-4c27-a7dc-b4b4b112f9b1,segment=NetworkSegment(fab7ad78-c438-48e7-8fdb-80ff50b8600c),segment_id=fab7ad78-c438-48e7-8fdb-80ff50b8600c)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:13:33.988311 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': 'f47160fc-9457-4c27-a7dc-b4b4b112f9b1', 'network_id': 'f70ee550-62a6-48db-bca5-a0b964bbcce9', 'port_id': 'f47160fc-9457-4c27-a7dc-b4b4b112f9b1', 'mac_address': 'fa:16:3e:0f:e5:2f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 173, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cd23e532-b366-42a0-82e4-ec7326cf3b48', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:13:33.988561 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-d5643c86-a0e9-482c-bbc5-015a606fb653 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:33.989170 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-d5643c86-a0e9-482c-bbc5-015a606fb653 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:33.990687 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-d5643c86-a0e9-482c-bbc5-015a606fb653 service neutron] 10.222.0.25 "PUT /v2.0/ports/2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e HTTP/1.1" status: 200 len: 1094 time: 0.6076777 Nov 08 16:13:33.991563 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '37e5636f-2ecf-4438-8be2-e973029678a1', 'tag': '2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e'}] {{(pid=101245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:13:33.993808 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9303bddee447de525cefc409d3d14f9dbe8ef1f21bfe9eb24fdef2609d4aa3c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7775fe96-097d-415f-bfce-4ce06f9636af" -d '{"events": [{"name": "network-changed", "server_uuid": "37e5636f-2ecf-4438-8be2-e973029678a1", "tag": "2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e"}]}' {{(pid=101245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:13:34.027513 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:34.029759 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5643c86-a0e9-482c-bbc5-015a606fb653 service neutron] Pushing event updated for resources: {'Port': ['ID=2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e,revision_number=3']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:34.038369 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:13:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-adc76234-8099-4c45-b1bb-0b54e184e83d x-openstack-request-id: req-adc76234-8099-4c45-b1bb-0b54e184e83d {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:13:34.038717 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "37e5636f-2ecf-4438-8be2-e973029678a1", "tag": "2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e", "status": "completed", "code": 200}]} {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:13:34.039666 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-adc76234-8099-4c45-b1bb-0b54e184e83d {{(pid=101245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:13:34.040312 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '37e5636f-2ecf-4438-8be2-e973029678a1', 'tag': '2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e', 'status': 'completed', 'code': 200} Nov 08 16:13:34.042185 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f47160fc-9457-4c27-a7dc-b4b4b112f9b1 {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:13:34.063041 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port f47160fc-9457-4c27-a7dc-b4b4b112f9b1, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=f47160fc-9457-4c27-a7dc-b4b4b112f9b1,segment=NetworkSegment(fab7ad78-c438-48e7-8fdb-80ff50b8600c),segment_id=fab7ad78-c438-48e7-8fdb-80ff50b8600c)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:13:34.066869 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:34.098653 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-9f8fb106-9f7e-4bd8-9c4d-2acc0550b50f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:34.100134 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-9f8fb106-9f7e-4bd8-9c4d-2acc0550b50f service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=9580ccbb790e4dff94da99ac8b1c98d5&device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 1097 time: 0.0408168 Nov 08 16:13:34.117763 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=f47160fc-9457-4c27-a7dc-b4b4b112f9b1,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:34.149959 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-a60f2a49-b886-4623-a294-a49edfedad09 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e HTTP/1.1" status: 200 len: 217 time: 0.0392773 Nov 08 16:13:34.206531 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-2d550a58-4630-4706-bf53-e129ea5044cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:34.207959 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-2d550a58-4630-4706-bf53-e129ea5044cb service neutron] 10.222.0.25 "GET /v2.0/subnets?id=d10afa0f-2bc3-4957-b3e4-84967992ae54 HTTP/1.1" status: 200 len: 849 time: 0.0458121 Nov 08 16:13:34.238311 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-71742b8a-380a-45ce-b83f-387ef62978a2 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0230677 Nov 08 16:13:34.328757 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-b40b9364-51b7-447e-896f-46da249b4519 service neutron] 10.222.0.25 "GET /v2.0/networks/e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0806627 Nov 08 16:13:34.520456 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6533f571-65bb-4281-93d4-7121e660a33a req-547bcb84-a031-44d1-939c-2a5764b2252f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:34.522023 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6533f571-65bb-4281-93d4-7121e660a33a req-547bcb84-a031-44d1-939c-2a5764b2252f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 945 time: 0.0513999 Nov 08 16:13:34.572105 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6533f571-65bb-4281-93d4-7121e660a33a req-01aab2c5-1372-4c9d-a443-4774b13cea6f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442603 Nov 08 16:13:34.782070 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef98dc7e-0ec6-4dcc-bd49-30b59b4f3a79 req-fea4fc5b-41d5-4e7d-87d2-bd72eb62fb7e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:34.783572 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ef98dc7e-0ec6-4dcc-bd49-30b59b4f3a79 req-fea4fc5b-41d5-4e7d-87d2-bd72eb62fb7e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 944 time: 0.0503700 Nov 08 16:13:34.833695 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ef98dc7e-0ec6-4dcc-bd49-30b59b4f3a79 req-92a51628-8391-450e-9cd6-d2a353db8d08 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432315 Nov 08 16:13:34.854511 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-2c6f770e-0e12-4b41-a8c8-705dc54823c9 req-c7004a31-4ac2-4260-b4b4-a5b9d95dd90e service neutron] 10.222.0.25 "GET /v2.0/networks/e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3136046 Nov 08 16:13:34.957356 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7775fe96-097d-415f-bfce-4ce06f9636af req-bca3f62a-6f7b-4b21-85e5-a983fcd40360 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:34.958752 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-7775fe96-097d-415f-bfce-4ce06f9636af req-bca3f62a-6f7b-4b21-85e5-a983fcd40360 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=9580ccbb790e4dff94da99ac8b1c98d5&device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 1097 time: 0.0388296 Nov 08 16:13:35.064490 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7775fe96-097d-415f-bfce-4ce06f9636af req-8c731d8b-a35a-41d4-803c-4202c40edf06 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:35.065989 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-7775fe96-097d-415f-bfce-4ce06f9636af req-8c731d8b-a35a-41d4-803c-4202c40edf06 service neutron] 10.222.0.25 "GET /v2.0/networks?id=e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e HTTP/1.1" status: 200 len: 910 time: 0.0931950 Nov 08 16:13:35.076716 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['f47160fc-9457-4c27-a7dc-b4b4b112f9b1'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:13:35.083740 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990f5877-b922-494c-903b-f8271622cdd6 req-97f4f998-fbda-418e-a0b4-85874b94651d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:35.085348 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-990f5877-b922-494c-903b-f8271622cdd6 req-97f4f998-fbda-418e-a0b4-85874b94651d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 944 time: 0.0555997 Nov 08 16:13:35.146948 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-990f5877-b922-494c-903b-f8271622cdd6 req-4057e079-47b4-4e81-a905-37186896d44b tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0554872 Nov 08 16:13:35.149593 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-7775fe96-097d-415f-bfce-4ce06f9636af req-6690f207-c20f-44c9-9cdb-c78333f77244 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e HTTP/1.1" status: 200 len: 217 time: 0.0443401 Nov 08 16:13:35.208262 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7775fe96-097d-415f-bfce-4ce06f9636af req-bc1ba101-bd3d-4202-af8b-b4a3b53091a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:35.210442 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-7775fe96-097d-415f-bfce-4ce06f9636af req-bc1ba101-bd3d-4202-af8b-b4a3b53091a6 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=d10afa0f-2bc3-4957-b3e4-84967992ae54 HTTP/1.1" status: 200 len: 849 time: 0.0513947 Nov 08 16:13:35.248303 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-7775fe96-097d-415f-bfce-4ce06f9636af req-5e0bb990-4437-4741-85bf-b40d8d6a2ad4 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0273979 Nov 08 16:13:35.355365 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-7775fe96-097d-415f-bfce-4ce06f9636af req-817d941a-7b82-445c-b148-33a76e030fa7 service neutron] 10.222.0.25 "GET /v2.0/networks/e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0926235 Nov 08 16:13:35.445504 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-7775fe96-097d-415f-bfce-4ce06f9636af req-aaf3c76c-7d83-46df-98bf-04612d5a0cc6 service neutron] 10.222.0.25 "GET /v2.0/networks/e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0822093 Nov 08 16:13:35.687700 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a0f3a32-84e4-42f7-93b9-33268fe76aa5 req-96da2f22-9aa2-402e-9dd6-dae247b92ca4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:35.689183 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5a0f3a32-84e4-42f7-93b9-33268fe76aa5 req-96da2f22-9aa2-402e-9dd6-dae247b92ca4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 945 time: 0.0479944 Nov 08 16:13:35.742484 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5a0f3a32-84e4-42f7-93b9-33268fe76aa5 req-c41e2d08-fda0-47d3-8d7a-3161ae583c67 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0466728 Nov 08 16:13:35.857143 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 17d7004d-111e-4cfc-904c-a17ed005bc2f up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:13:35.909499 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning for port 17d7004d-111e-4cfc-904c-a17ed005bc2f completed by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 16:13:35.915483 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port 17d7004d-111e-4cfc-904c-a17ed005bc2f triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:13:35.915483 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:35.955497 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e8c44e-b3d8-4c6a-87b5-3548e43e7155 req-af03055e-7800-4676-b4f6-de50b9990070 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:35.957148 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d2e8c44e-b3d8-4c6a-87b5-3548e43e7155 req-af03055e-7800-4676-b4f6-de50b9990070 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 944 time: 0.0541441 Nov 08 16:13:35.997741 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:36.017071 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d2e8c44e-b3d8-4c6a-87b5-3548e43e7155 req-cf0cd1b6-b993-4f28-8296-a0ae70bba2eb tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0528350 Nov 08 16:13:36.022748 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd643b8f8-c205-49ba-8889-30842481b95f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '17d7004d-111e-4cfc-904c-a17ed005bc2f'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:13:36.025001 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-36c4b10f-f4f3-45c9-acf4-052f8700c15f" -d '{"events": [{"server_uuid": "d643b8f8-c205-49ba-8889-30842481b95f", "name": "network-vif-plugged", "status": "completed", "tag": "17d7004d-111e-4cfc-904c-a17ed005bc2f"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:13:36.046676 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 17d7004d-111e-4cfc-904c-a17ed005bc2f, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=17d7004d-111e-4cfc-904c-a17ed005bc2f,segment=NetworkSegment(1383b9f8-d178-4a90-828c-184fa1886253),segment_id=1383b9f8-d178-4a90-828c-184fa1886253)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:13:36.052067 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:36.080323 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:13:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-222cfe80-ff7a-436f-8294-275229ea90f9 x-openstack-request-id: req-222cfe80-ff7a-436f-8294-275229ea90f9 {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:13:36.080948 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d643b8f8-c205-49ba-8889-30842481b95f", "name": "network-vif-plugged", "status": "completed", "tag": "17d7004d-111e-4cfc-904c-a17ed005bc2f", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:13:36.080948 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-222cfe80-ff7a-436f-8294-275229ea90f9 {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:13:36.081442 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd643b8f8-c205-49ba-8889-30842481b95f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '17d7004d-111e-4cfc-904c-a17ed005bc2f', 'code': 200} Nov 08 16:13:36.119427 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=17d7004d-111e-4cfc-904c-a17ed005bc2f,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:36.265506 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad938d79-5758-478d-a7c3-a17bba4b7388 req-03114073-1043-49a6-9b82-12b380eab9df tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:36.267055 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ad938d79-5758-478d-a7c3-a17bba4b7388 req-03114073-1043-49a6-9b82-12b380eab9df tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 944 time: 0.0500417 Nov 08 16:13:36.314151 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ad938d79-5758-478d-a7c3-a17bba4b7388 req-93cad5ae-e06c-4c40-a93d-5fcb39bb61a9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411131 Nov 08 16:13:36.466025 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3a93f45-843c-402b-a603-149d6e3daca3 req-ceff9737-b150-4ecf-85d3-85938e97ebea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:36.467525 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-d3a93f45-843c-402b-a603-149d6e3daca3 req-ceff9737-b150-4ecf-85d3-85938e97ebea service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 1099 time: 0.0436158 Nov 08 16:13:36.516874 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-d3a93f45-843c-402b-a603-149d6e3daca3 req-d1350493-e666-4477-a6ce-c92932440836 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404370 Nov 08 16:13:36.868414 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c51b2174-bff9-4aab-af2b-16911f11a654 req-24acbe1b-6807-4f6e-abeb-2f2de8f33353 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:36.869999 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c51b2174-bff9-4aab-af2b-16911f11a654 req-24acbe1b-6807-4f6e-abeb-2f2de8f33353 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 946 time: 0.0498726 Nov 08 16:13:36.952441 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c51b2174-bff9-4aab-af2b-16911f11a654 req-9815cd0e-0440-4b8b-bb26-9d49ef102a5e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0764134 Nov 08 16:13:36.972591 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e15db72-95b0-488d-b19d-1ce23dbc3bd1 req-1e5ce4a9-99eb-4caf-9999-0470d86fc629 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:36.972591 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1e15db72-95b0-488d-b19d-1ce23dbc3bd1 req-1e5ce4a9-99eb-4caf-9999-0470d86fc629 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0841801 Nov 08 16:13:37.009950 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71ce8bab-f963-4477-96f5-fc51b6935f89 req-f00d18ab-fbfc-43fd-bc9a-2549398a3bcf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:37.011841 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-71ce8bab-f963-4477-96f5-fc51b6935f89 req-f00d18ab-fbfc-43fd-bc9a-2549398a3bcf service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=4818358a827143eb9ace58a26713cdf0&device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 1098 time: 0.0447314 Nov 08 16:13:37.019583 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1e15db72-95b0-488d-b19d-1ce23dbc3bd1 req-8e192564-2e15-4a4f-81dd-f5c435fda4e0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427539 Nov 08 16:13:37.131187 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9649dd42-04d0-4564-9f5c-6d200a9c7878 req-65489218-ed24-4053-a66c-b742fe688472 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:37.133087 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9649dd42-04d0-4564-9f5c-6d200a9c7878 req-65489218-ed24-4053-a66c-b742fe688472 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 944 time: 0.0488660 Nov 08 16:13:37.155800 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71ce8bab-f963-4477-96f5-fc51b6935f89 req-dfb318d5-cc14-485a-a537-2fa3c33d600e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:37.157257 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-71ce8bab-f963-4477-96f5-fc51b6935f89 req-dfb318d5-cc14-485a-a537-2fa3c33d600e service neutron] 10.222.0.25 "GET /v2.0/networks?id=2d5b5768-37f3-49a1-b451-2803f6f97429 HTTP/1.1" status: 200 len: 919 time: 0.0895915 Nov 08 16:13:37.179470 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9649dd42-04d0-4564-9f5c-6d200a9c7878 req-1167e2db-d7b2-4620-a0b6-a13578d86db6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401275 Nov 08 16:13:37.212161 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-71ce8bab-f963-4477-96f5-fc51b6935f89 req-33de82cf-8024-4bfa-b4d6-7aef4900af9c service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=17db566c-bf28-4091-b7f6-4ffa5f80c982 HTTP/1.1" status: 200 len: 217 time: 0.0349712 Nov 08 16:13:37.266067 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71ce8bab-f963-4477-96f5-fc51b6935f89 req-5f583725-ddd8-418b-ad25-ef5edde8e031 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:37.267484 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-71ce8bab-f963-4477-96f5-fc51b6935f89 req-5f583725-ddd8-418b-ad25-ef5edde8e031 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=6936707c-bd3f-4cd8-9462-a4af0ea16ed8 HTTP/1.1" status: 200 len: 858 time: 0.0421462 Nov 08 16:13:37.342305 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-71ce8bab-f963-4477-96f5-fc51b6935f89 req-0a2058ec-b073-486a-8bf4-ae65b6d710d8 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=2d5b5768-37f3-49a1-b451-2803f6f97429&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0251906 Nov 08 16:13:37.432119 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc0b2cec-fec4-421d-9201-21087727d6a1 req-ca2a7616-d793-4b60-a436-67c50a128863 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:37.433598 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dc0b2cec-fec4-421d-9201-21087727d6a1 req-ca2a7616-d793-4b60-a436-67c50a128863 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 944 time: 0.0507417 Nov 08 16:13:37.447255 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-71ce8bab-f963-4477-96f5-fc51b6935f89 req-fa86fc81-08d6-4a54-bbac-c72006e3acab service neutron] 10.222.0.25 "GET /v2.0/networks/2d5b5768-37f3-49a1-b451-2803f6f97429?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0895634 Nov 08 16:13:37.484890 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dc0b2cec-fec4-421d-9201-21087727d6a1 req-46eb131f-cb5a-4eeb-a6d5-5f65e4d4e767 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453057 Nov 08 16:13:37.543579 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-71ce8bab-f963-4477-96f5-fc51b6935f89 req-a847139d-328d-4bf1-af3f-ef2bf57f5178 service neutron] 10.222.0.25 "GET /v2.0/networks/2d5b5768-37f3-49a1-b451-2803f6f97429?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0826502 Nov 08 16:13:37.888291 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device f47160fc-9457-4c27-a7dc-b4b4b112f9b1 up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:13:37.935469 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning for port f47160fc-9457-4c27-a7dc-b4b4b112f9b1 completed by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 16:13:37.939367 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port f47160fc-9457-4c27-a7dc-b4b4b112f9b1 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:13:37.939800 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:38.019723 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:38.054732 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port f47160fc-9457-4c27-a7dc-b4b4b112f9b1, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=f47160fc-9457-4c27-a7dc-b4b4b112f9b1,segment=NetworkSegment(fab7ad78-c438-48e7-8fdb-80ff50b8600c),segment_id=fab7ad78-c438-48e7-8fdb-80ff50b8600c)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:13:38.059917 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:38.076052 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-007d1dbd-0252-4c53-ada3-9df3c3a328e7 req-94f7ade6-5707-4edb-a0b5-ee62806fd5b8 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:38.077528 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-007d1dbd-0252-4c53-ada3-9df3c3a328e7 req-94f7ade6-5707-4edb-a0b5-ee62806fd5b8 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 946 time: 0.0518343 Nov 08 16:13:38.083241 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cf462447-a55a-46b8-9afd-afca942aa011', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f47160fc-9457-4c27-a7dc-b4b4b112f9b1'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:13:38.086402 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0fea6bc7-f417-4ab2-80d4-4d4025d67450" -d '{"events": [{"server_uuid": "cf462447-a55a-46b8-9afd-afca942aa011", "name": "network-vif-plugged", "status": "completed", "tag": "f47160fc-9457-4c27-a7dc-b4b4b112f9b1"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:13:38.123888 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=f47160fc-9457-4c27-a7dc-b4b4b112f9b1,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:38.127472 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-87df0e84-08c0-4abc-837d-4a4db0a4cc87 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:38.166973 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-007d1dbd-0252-4c53-ada3-9df3c3a328e7 req-0b43bc3e-4dd6-423b-918b-24a2d147c279 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0801804 Nov 08 16:13:38.178931 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf305f95-44c1-4042-83be-022b5d8ac12e req-0d1c03ea-7653-4d00-8eb5-1ce901f5e91e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:38.180728 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bf305f95-44c1-4042-83be-022b5d8ac12e req-0d1c03ea-7653-4d00-8eb5-1ce901f5e91e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0792193 Nov 08 16:13:38.211092 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:13:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-32b21b4d-8e99-4f15-b6a3-0c332d4de27b x-openstack-request-id: req-32b21b4d-8e99-4f15-b6a3-0c332d4de27b {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:13:38.211384 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cf462447-a55a-46b8-9afd-afca942aa011", "name": "network-vif-plugged", "status": "completed", "tag": "f47160fc-9457-4c27-a7dc-b4b4b112f9b1", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:13:38.211636 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-32b21b4d-8e99-4f15-b6a3-0c332d4de27b {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:13:38.212027 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cf462447-a55a-46b8-9afd-afca942aa011', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f47160fc-9457-4c27-a7dc-b4b4b112f9b1', 'code': 200} Nov 08 16:13:38.234945 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bf305f95-44c1-4042-83be-022b5d8ac12e req-1f796ddd-97e4-4bd5-a8e9-00e907c67cb4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0481081 Nov 08 16:13:38.342571 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83912ed1-4282-4f55-a15c-308e775d8939 req-06781721-8b10-48f7-aed8-22af7110dd2f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:38.344085 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-83912ed1-4282-4f55-a15c-308e775d8939 req-06781721-8b10-48f7-aed8-22af7110dd2f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 945 time: 0.0523055 Nov 08 16:13:38.393187 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-83912ed1-4282-4f55-a15c-308e775d8939 req-0fe161cd-9c35-45e4-9b65-a90306cc1e99 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431585 Nov 08 16:13:38.429394 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2f265e1-7a6d-4274-bc73-39207eeada8d req-a65f70b7-9208-4a78-917e-e01a12bae33d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:38.430911 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-b2f265e1-7a6d-4274-bc73-39207eeada8d req-a65f70b7-9208-4a78-917e-e01a12bae33d service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 1098 time: 0.0441625 Nov 08 16:13:38.482747 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-b2f265e1-7a6d-4274-bc73-39207eeada8d req-7d71c8d9-f419-43dd-b28c-77762a46a534 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0368285 Nov 08 16:13:38.600258 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a1da838-a50b-498a-9252-65cf221133ad req-2a6e0b06-453b-4910-a615-cfa21135ab19 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:38.601677 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5a1da838-a50b-498a-9252-65cf221133ad req-2a6e0b06-453b-4910-a615-cfa21135ab19 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 944 time: 0.0495355 Nov 08 16:13:38.648707 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5a1da838-a50b-498a-9252-65cf221133ad req-0fab2d50-b0af-40c1-b156-151519b287a5 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411553 Nov 08 16:13:39.286839 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58aa1647-125b-4206-b916-f7933aa25750 req-b8cc0033-1797-4e21-945b-d6d7efbd4198 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:39.288799 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-58aa1647-125b-4206-b916-f7933aa25750 req-b8cc0033-1797-4e21-945b-d6d7efbd4198 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 946 time: 0.0545065 Nov 08 16:13:39.361912 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-58aa1647-125b-4206-b916-f7933aa25750 req-efb30692-03d3-4884-92f0-86ab7d66e1ab tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0670066 Nov 08 16:13:39.379737 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b94c3df-1291-4fc2-91b2-9165adfd908f req-51280b04-a9f8-489d-a033-5dca8237b70e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:39.380741 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4b94c3df-1291-4fc2-91b2-9165adfd908f req-51280b04-a9f8-489d-a033-5dca8237b70e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0710726 Nov 08 16:13:39.428999 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4b94c3df-1291-4fc2-91b2-9165adfd908f req-d4cf7766-d003-421d-bcb1-c4951b3f6121 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414662 Nov 08 16:13:39.529125 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be408792-4aa8-401e-b6ae-8a7086772a02 req-b2ca39b3-13da-4354-88f4-0c9a1813f1de tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:39.531191 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-be408792-4aa8-401e-b6ae-8a7086772a02 req-b2ca39b3-13da-4354-88f4-0c9a1813f1de tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 946 time: 0.0485489 Nov 08 16:13:39.607731 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-be408792-4aa8-401e-b6ae-8a7086772a02 req-4c787637-798a-4300-b0f8-81b4191228f9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0708907 Nov 08 16:13:39.622199 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f52fcee-14d2-420d-8dc8-6510bc04e57e req-352e6957-f54a-4599-b67e-64bcf4ca21ac tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:39.623899 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8f52fcee-14d2-420d-8dc8-6510bc04e57e req-352e6957-f54a-4599-b67e-64bcf4ca21ac tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 945 time: 0.0705833 Nov 08 16:13:39.630641 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 35290) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:13:39.672572 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8f52fcee-14d2-420d-8dc8-6510bc04e57e req-9f42bee5-b333-471c-90cb-9d51d4284ba7 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428782 Nov 08 16:13:39.761144 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68ef52d0-c273-40cf-9562-21d7a5ebf4f2 req-43696fcf-b120-4f62-8d01-0a22521518cc tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:39.762665 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-68ef52d0-c273-40cf-9562-21d7a5ebf4f2 req-43696fcf-b120-4f62-8d01-0a22521518cc tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 944 time: 0.0477865 Nov 08 16:13:39.773502 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2b164ef6-e78a-4bb5-b1dc-404985a5672b tempest-TestVolumeBootPattern-411305480 tempest-TestVolumeBootPattern-411305480-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:39.775075 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-2b164ef6-e78a-4bb5-b1dc-404985a5672b tempest-TestVolumeBootPattern-411305480 tempest-TestVolumeBootPattern-411305480-project-admin] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 1094 time: 0.1433527 Nov 08 16:13:39.778073 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 35296) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:13:39.782304 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-7ebfc9ed-82fc-45c4-a490-ef0138f41ddc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Request body: {'floatingip': {'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'port_id': '17d7004d-111e-4cfc-904c-a17ed005bc2f', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'fixed_ip_address': '172.20.0.14'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:13:39.806722 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7ebfc9ed-82fc-45c4-a490-ef0138f41ddc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for floatingip, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:39.810335 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-68ef52d0-c273-40cf-9562-21d7a5ebf4f2 req-f6706a21-12a7-4ab0-a2a5-62953882768c tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415611 Nov 08 16:13:39.902805 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7ebfc9ed-82fc-45c4-a490-ef0138f41ddc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:40.001250 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_common [None req-7ebfc9ed-82fc-45c4-a490-ef0138f41ddc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Allocated IP 172.27.3.215 (68f46265-b42a-49a0-8d57-f9362045cd9b/4728e4be-5a19-43c0-89cf-ced2a190645d/41e0a3c4-8827-4e58-9974-cbbe38a57389) {{(pid=101245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:13:40.102672 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7ebfc9ed-82fc-45c4-a490-ef0138f41ddc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for port, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:40.135249 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7ebfc9ed-82fc-45c4-a490-ef0138f41ddc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:40.171033 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7ebfc9ed-82fc-45c4-a490-ef0138f41ddc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Network 68f46265-b42a-49a0-8d57-f9362045cd9b is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:13:40.176089 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-7ebfc9ed-82fc-45c4-a490-ef0138f41ddc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:13:40.179593 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ebfc9ed-82fc-45c4-a490-ef0138f41ddc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Received port after_create {{(pid=101245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:13:40.184752 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ebfc9ed-82fc-45c4-a490-ef0138f41ddc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Pushing event updated for resources: {'Port': ['ID=41e0a3c4-8827-4e58-9974-cbbe38a57389,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:40.415805 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:13:40.525341 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e,segment=NetworkSegment(4d73fdfb-694f-4679-be5c-5e9ca8483c31),segment_id=4d73fdfb-694f-4679-be5c-5e9ca8483c31)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:13:40.537493 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': '2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e', 'network_id': 'e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e', 'port_id': '2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e', 'mac_address': 'fa:16:3e:af:72:f3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 189, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd10afa0f-2bc3-4957-b3e4-84967992ae54', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:13:40.556084 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ff6a5cb-b6e1-497c-b23c-d299438a4def req-01eafbd4-0ba4-46e4-b026-ef41a0d8fb69 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:40.559868 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2ff6a5cb-b6e1-497c-b23c-d299438a4def req-01eafbd4-0ba4-46e4-b026-ef41a0d8fb69 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0580640 Nov 08 16:13:40.573689 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7ebfc9ed-82fc-45c4-a490-ef0138f41ddc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:40.586732 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:40.596477 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-071e1737-c9c3-4816-812a-b8b3887e2878 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:40.604378 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:13:40.608709 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2ff6a5cb-b6e1-497c-b23c-d299438a4def req-c2620700-2d75-4912-8fcd-f464ff359249 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443873 Nov 08 16:13:40.634929 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e,segment=NetworkSegment(4d73fdfb-694f-4679-be5c-5e9ca8483c31),segment_id=4d73fdfb-694f-4679-be5c-5e9ca8483c31)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:13:40.639093 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:40.664965 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7ebfc9ed-82fc-45c4-a490-ef0138f41ddc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:40.697069 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:40.817419 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7ebfc9ed-82fc-45c4-a490-ef0138f41ddc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for port, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:40.822997 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7ebfc9ed-82fc-45c4-a490-ef0138f41ddc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7464016'] for port, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:40.891316 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ebfc9ed-82fc-45c4-a490-ef0138f41ddc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Pushing event updated for resources: {'Port': ['ID=41e0a3c4-8827-4e58-9974-cbbe38a57389,revision_number=2']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:40.900117 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7ebfc9ed-82fc-45c4-a490-ef0138f41ddc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-2032271'] for floatingip, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:40.998492 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.db.l3_db [None req-7ebfc9ed-82fc-45c4-a490-ef0138f41ddc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Floating IP a86b2433-a749-44fc-91a7-e9bec1465b20 associated. External IP: 172.27.3.215, port: 17d7004d-111e-4cfc-904c-a17ed005bc2f. Nov 08 16:13:41.199638 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7ebfc9ed-82fc-45c4-a490-ef0138f41ddc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Router f80d01f3-bee2-4682-8f4a-92536ad96209 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101245) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:13:41.303316 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7ebfc9ed-82fc-45c4-a490-ef0138f41ddc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101245) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:13:41.312712 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8498747c-0bed-4dfc-9c69-b1c6c41dfeb9 None None] Sync routers for ids ['f80d01f3-bee2-4682-8f4a-92536ad96209'] in dv-cinder-816187-2-iscsi {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:13:41.320094 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7ebfc9ed-82fc-45c4-a490-ef0138f41ddc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for floatingip, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:41.323013 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8498747c-0bed-4dfc-9c69-b1c6c41dfeb9 None None] Routers {'f80d01f3-bee2-4682-8f4a-92536ad96209'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:13:41.323621 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-8498747c-0bed-4dfc-9c69-b1c6c41dfeb9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:13:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['f80d01f3-bee2-4682-8f4a-92536ad96209'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:13:41.346149 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-7ebfc9ed-82fc-45c4-a490-ef0138f41ddc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.5670424 Nov 08 16:13:41.346777 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd643b8f8-c205-49ba-8889-30842481b95f', 'tag': '17d7004d-111e-4cfc-904c-a17ed005bc2f'}] {{(pid=101245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:13:41.348948 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9303bddee447de525cefc409d3d14f9dbe8ef1f21bfe9eb24fdef2609d4aa3c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-92ba8d42-d305-40bd-8b5b-926c27fd933e" -d '{"events": [{"name": "network-changed", "server_uuid": "d643b8f8-c205-49ba-8889-30842481b95f", "tag": "17d7004d-111e-4cfc-904c-a17ed005bc2f"}]}' {{(pid=101245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:13:41.431418 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-8498747c-0bed-4dfc-9c69-b1c6c41dfeb9 None None] Set router f80d01f3-bee2-4682-8f4a-92536ad96209 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:13:41.521616 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:41.719653 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-8498747c-0bed-4dfc-9c69-b1c6c41dfeb9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 4, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': 'a86b2433-a749-44fc-91a7-e9bec1465b20', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'floating_ip_address': '172.27.3.215', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'port_id': '17d7004d-111e-4cfc-904c-a17ed005bc2f', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 340, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'mac_address': 'fa:16:3e:f2:d2:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd643b8f8-c205-49ba-8889-30842481b95f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:13:40Z', 'updated_at': '2021-11-08T16:13:40Z', 'revision_number': 0, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbdf39d9-310f-42ea-a1f1-4e1b15048b73', 'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'mac_address': 'fa:16:3e:13:ec:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_interface', 'standard_attr_id': 228, 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:28Z', 'updated_at': '2021-11-08T16:12:32Z', 'revision_number': 5, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'subnets': [{'id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:13:41.746671 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8498747c-0bed-4dfc-9c69-b1c6c41dfeb9 None None] Checking router: f80d01f3-bee2-4682-8f4a-92536ad96209 for host: dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:13:41.754869 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8498747c-0bed-4dfc-9c69-b1c6c41dfeb9 None None] Routers {'f80d01f3-bee2-4682-8f4a-92536ad96209'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:13:41.755450 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-8498747c-0bed-4dfc-9c69-b1c6c41dfeb9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:13:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['f80d01f3-bee2-4682-8f4a-92536ad96209'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:13:41.857297 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-8498747c-0bed-4dfc-9c69-b1c6c41dfeb9 None None] Set router f80d01f3-bee2-4682-8f4a-92536ad96209 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:13:42.067108 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-8498747c-0bed-4dfc-9c69-b1c6c41dfeb9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 4, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': 'a86b2433-a749-44fc-91a7-e9bec1465b20', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'floating_ip_address': '172.27.3.215', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'port_id': '17d7004d-111e-4cfc-904c-a17ed005bc2f', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 340, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'mac_address': 'fa:16:3e:f2:d2:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd643b8f8-c205-49ba-8889-30842481b95f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:13:40Z', 'updated_at': '2021-11-08T16:13:40Z', 'revision_number': 0, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbdf39d9-310f-42ea-a1f1-4e1b15048b73', 'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'mac_address': 'fa:16:3e:13:ec:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_interface', 'standard_attr_id': 228, 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:28Z', 'updated_at': '2021-11-08T16:12:32Z', 'revision_number': 5, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'subnets': [{'id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:13:42.095643 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8498747c-0bed-4dfc-9c69-b1c6c41dfeb9 None None] The sync data for ids ['f80d01f3-bee2-4682-8f4a-92536ad96209'] in dv-cinder-816187-2-iscsi is: [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 4, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': 'a86b2433-a749-44fc-91a7-e9bec1465b20', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'floating_ip_address': '172.27.3.215', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'port_id': '17d7004d-111e-4cfc-904c-a17ed005bc2f', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 340, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'mac_address': 'fa:16:3e:f2:d2:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd643b8f8-c205-49ba-8889-30842481b95f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:13:40Z', 'updated_at': '2021-11-08T16:13:40Z', 'revision_number': 0, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbdf39d9-310f-42ea-a1f1-4e1b15048b73', 'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'mac_address': 'fa:16:3e:13:ec:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_interface', 'standard_attr_id': 228, 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:28Z', 'updated_at': '2021-11-08T16:12:32Z', 'revision_number': 5, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'subnets': [{'id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:13:42.274676 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6c18aae-5abf-44ba-873b-8ab5869add66 None None] New status for floating IP a86b2433-a749-44fc-91a7-e9bec1465b20: ACTIVE {{(pid=101246) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 16:13:43.244611 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:43.949125 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:46.606410 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:13:47.932017 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:48.018059 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5144005b-06ad-4cf0-a8cd-f772a5d750d4 req-379506e5-c404-4315-8e6f-a9de458b86f0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:48.019698 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5144005b-06ad-4cf0-a8cd-f772a5d750d4 req-379506e5-c404-4315-8e6f-a9de458b86f0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 945 time: 0.0520802 Nov 08 16:13:48.088205 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5144005b-06ad-4cf0-a8cd-f772a5d750d4 req-87d32d09-45f8-46f5-8b59-b3741cdde590 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0620034 Nov 08 16:13:48.110611 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-559dc660-66b2-46c2-9929-055a2b24ede8 req-71dd59a3-53c6-46f0-ad65-78eeb682c9ae tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:48.112090 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-559dc660-66b2-46c2-9929-055a2b24ede8 req-71dd59a3-53c6-46f0-ad65-78eeb682c9ae tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 945 time: 0.0615444 Nov 08 16:13:48.134846 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:13:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d7d672a6-48e4-439b-a0c5-cd0a146e66c4 x-openstack-request-id: req-d7d672a6-48e4-439b-a0c5-cd0a146e66c4 {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:13:48.135334 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d643b8f8-c205-49ba-8889-30842481b95f", "tag": "17d7004d-111e-4cfc-904c-a17ed005bc2f", "status": "completed", "code": 200}]} {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:13:48.135430 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-d7d672a6-48e4-439b-a0c5-cd0a146e66c4 {{(pid=101245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:13:48.135748 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd643b8f8-c205-49ba-8889-30842481b95f', 'tag': '17d7004d-111e-4cfc-904c-a17ed005bc2f', 'status': 'completed', 'code': 200} Nov 08 16:13:48.162791 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-559dc660-66b2-46c2-9929-055a2b24ede8 req-042df842-d796-43d1-8e6f-a69ebcf12c14 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441105 Nov 08 16:13:48.223319 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7cb10ec-19ed-4d93-b120-740ff4c61597 req-f89fcb32-a9ec-4b09-999e-6752561b333a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:48.224825 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a7cb10ec-19ed-4d93-b120-740ff4c61597 req-f89fcb32-a9ec-4b09-999e-6752561b333a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0473361 Nov 08 16:13:48.270797 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a7cb10ec-19ed-4d93-b120-740ff4c61597 req-b139feb3-7d2b-4f14-8d80-bec4d78130c9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400963 Nov 08 16:13:48.346725 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ba8d42-d305-40bd-8b5b-926c27fd933e req-0cf3f53d-3f7c-469f-abd9-f674f21f72ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:48.348347 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-92ba8d42-d305-40bd-8b5b-926c27fd933e req-0cf3f53d-3f7c-469f-abd9-f674f21f72ed service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=343d5ca096394f87bea0950aa3811a13&device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 1099 time: 0.0415740 Nov 08 16:13:48.440492 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ba8d42-d305-40bd-8b5b-926c27fd933e req-b76fb373-4fca-4e63-8e8d-4a89400ef49f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:48.441993 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-92ba8d42-d305-40bd-8b5b-926c27fd933e req-b76fb373-4fca-4e63-8e8d-4a89400ef49f service neutron] 10.222.0.25 "GET /v2.0/networks?id=a15e051b-c130-4140-aaf2-a45ea7af5b43 HTTP/1.1" status: 200 len: 913 time: 0.0860174 Nov 08 16:13:48.541624 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-92ba8d42-d305-40bd-8b5b-926c27fd933e req-1464d137-c735-48cd-a349-8583859b2699 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=17d7004d-111e-4cfc-904c-a17ed005bc2f HTTP/1.1" status: 200 len: 1002 time: 0.0896297 Nov 08 16:13:48.597699 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ba8d42-d305-40bd-8b5b-926c27fd933e req-e6730758-f663-49c3-91ca-89eba9276596 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:48.599178 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-92ba8d42-d305-40bd-8b5b-926c27fd933e req-e6730758-f663-49c3-91ca-89eba9276596 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=6e4d65b1-4f2c-453a-847c-970dff985732 HTTP/1.1" status: 200 len: 851 time: 0.0466392 Nov 08 16:13:48.644176 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ba8d42-d305-40bd-8b5b-926c27fd933e req-6452a50b-1570-44a1-a088-b05bde42aca8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:48.645589 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-92ba8d42-d305-40bd-8b5b-926c27fd933e req-6452a50b-1570-44a1-a088-b05bde42aca8 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=a15e051b-c130-4140-aaf2-a45ea7af5b43&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0378230 Nov 08 16:13:48.737195 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-92ba8d42-d305-40bd-8b5b-926c27fd933e req-8749ac24-7234-439f-a299-6046047a085e service neutron] 10.222.0.25 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0827460 Nov 08 16:13:48.829922 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-92ba8d42-d305-40bd-8b5b-926c27fd933e req-6543a40e-24dd-41b6-abf6-62b2ed0f8a4f service neutron] 10.222.0.25 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0815220 Nov 08 16:13:49.220398 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f27edf1-f683-4f4d-92a8-6d45abf7d3d0 req-040b656e-ee9b-413c-aa40-6b70353179d8 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:49.221933 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8f27edf1-f683-4f4d-92a8-6d45abf7d3d0 req-040b656e-ee9b-413c-aa40-6b70353179d8 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 945 time: 0.0492387 Nov 08 16:13:49.508446 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8f27edf1-f683-4f4d-92a8-6d45abf7d3d0 req-f03fa577-3c75-4dba-877f-0f4031e49a7b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2796414 Nov 08 16:13:49.520259 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58c65807-7608-4ecd-8d29-a333277a938f req-de54ce99-e566-494b-b062-c64b77af9d3d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:49.522243 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-58c65807-7608-4ecd-8d29-a333277a938f req-de54ce99-e566-494b-b062-c64b77af9d3d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 945 time: 0.2871020 Nov 08 16:13:49.576380 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-58c65807-7608-4ecd-8d29-a333277a938f req-ecae103c-04d3-4bda-ba9b-af130365d587 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477331 Nov 08 16:13:49.614245 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cd8710d-970a-4f55-8f8e-e3053b3a33f5 req-f595acb2-6b1e-45d6-b4fb-735110af78b7 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:49.616132 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4cd8710d-970a-4f55-8f8e-e3053b3a33f5 req-f595acb2-6b1e-45d6-b4fb-735110af78b7 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0515525 Nov 08 16:13:49.665432 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4cd8710d-970a-4f55-8f8e-e3053b3a33f5 req-6e22b964-04c6-4bb0-addd-a8a519823cab tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433967 Nov 08 16:13:49.973932 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:13:50.625206 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe52810f-59c8-4339-8dca-5f329b5ff33e req-ffe53f57-d4fb-4a52-8a63-de82f98628ff tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:50.626708 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fe52810f-59c8-4339-8dca-5f329b5ff33e req-ffe53f57-d4fb-4a52-8a63-de82f98628ff tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 945 time: 0.0498250 Nov 08 16:13:50.697618 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fe52810f-59c8-4339-8dca-5f329b5ff33e req-d30f043f-c39e-4a3e-b1d5-54064d51b2dd tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0644929 Nov 08 16:13:50.712620 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e8af8cf-0d7a-4fc0-8298-f09d04375f5d req-9b336dca-5162-49d3-9ecb-48770f164bea tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:50.714074 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0e8af8cf-0d7a-4fc0-8298-f09d04375f5d req-9b336dca-5162-49d3-9ecb-48770f164bea tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 945 time: 0.0659471 Nov 08 16:13:50.769452 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0e8af8cf-0d7a-4fc0-8298-f09d04375f5d req-2313c257-630e-412f-a098-6e12b3b48876 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492826 Nov 08 16:13:50.804438 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31ca1fb8-76e1-48c5-a77c-e525ae13955e req-a23abcb3-94bd-42b8-9a56-5737522e0b08 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:50.805887 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-31ca1fb8-76e1-48c5-a77c-e525ae13955e req-a23abcb3-94bd-42b8-9a56-5737522e0b08 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0520875 Nov 08 16:13:50.853989 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-31ca1fb8-76e1-48c5-a77c-e525ae13955e req-766cf14e-b1a0-4688-ba74-94cc89576f81 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422771 Nov 08 16:13:51.813326 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2f864c1-001b-43ef-b2d1-33da44d396b8 req-8e70d8ce-691e-49fa-9668-3bc921d0ea4c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:51.815142 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b2f864c1-001b-43ef-b2d1-33da44d396b8 req-8e70d8ce-691e-49fa-9668-3bc921d0ea4c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 945 time: 0.0501528 Nov 08 16:13:51.884790 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b2f864c1-001b-43ef-b2d1-33da44d396b8 req-27cd00f5-ad30-4cf6-904b-c1ccbc431216 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0629220 Nov 08 16:13:51.903897 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35a35804-3c2a-44e9-969b-2982b2e6bf1a req-b63cc858-0684-45e6-9654-eb6fc81f0f67 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:51.905796 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-35a35804-3c2a-44e9-969b-2982b2e6bf1a req-b63cc858-0684-45e6-9654-eb6fc81f0f67 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 945 time: 0.0591488 Nov 08 16:13:51.937681 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:13:51.987890 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-35a35804-3c2a-44e9-969b-2982b2e6bf1a req-0daa7d43-d7e5-4a46-8dca-1abba95b8c38 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0753539 Nov 08 16:13:52.008344 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning for port 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e completed by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 16:13:52.009328 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5724ec58-ce0c-4e62-870b-fe877cf33896 req-4eca9945-ea38-4707-8cec-5467664b1bfb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:52.012707 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:13:52.013267 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:52.016515 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5724ec58-ce0c-4e62-870b-fe877cf33896 req-4eca9945-ea38-4707-8cec-5467664b1bfb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0705624 Nov 08 16:13:52.067184 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5724ec58-ce0c-4e62-870b-fe877cf33896 req-282f139b-c1ca-403b-86cb-70c64a4ca67f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498116 Nov 08 16:13:52.109923 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:52.131935 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '37e5636f-2ecf-4438-8be2-e973029678a1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:13:52.134345 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cf29ed55-880e-4c84-935e-b668ee285a4c" -d '{"events": [{"server_uuid": "37e5636f-2ecf-4438-8be2-e973029678a1", "name": "network-vif-plugged", "status": "completed", "tag": "2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:13:52.147912 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e,segment=NetworkSegment(4d73fdfb-694f-4679-be5c-5e9ca8483c31),segment_id=4d73fdfb-694f-4679-be5c-5e9ca8483c31)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:13:52.151801 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:52.174127 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:13:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e64b1dad-eaf2-4d15-a572-8de733417af5 x-openstack-request-id: req-e64b1dad-eaf2-4d15-a572-8de733417af5 {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:13:52.174437 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "37e5636f-2ecf-4438-8be2-e973029678a1", "name": "network-vif-plugged", "status": "completed", "tag": "2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:13:52.174692 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-e64b1dad-eaf2-4d15-a572-8de733417af5 {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:13:52.175073 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '37e5636f-2ecf-4438-8be2-e973029678a1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e', 'code': 200} Nov 08 16:13:52.206402 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:52.360404 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a61ec8-e08a-42b6-94ed-15025e2aae6d req-d6fb3244-7750-482e-9607-00ba4014ca7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:52.361884 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-32a61ec8-e08a-42b6-94ed-15025e2aae6d req-d6fb3244-7750-482e-9607-00ba4014ca7a service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 1099 time: 0.0388234 Nov 08 16:13:52.408674 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-32a61ec8-e08a-42b6-94ed-15025e2aae6d req-91e28693-e238-45fa-ac2f-31374f2759ff service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389926 Nov 08 16:13:53.111654 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6248765-6f55-45de-8567-c56904c29b96 req-0fce74a5-0cbb-44ab-bba3-e00a739db742 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:53.113147 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d6248765-6f55-45de-8567-c56904c29b96 req-0fce74a5-0cbb-44ab-bba3-e00a739db742 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 946 time: 0.0475173 Nov 08 16:13:53.182340 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d6248765-6f55-45de-8567-c56904c29b96 req-eb32d275-915c-409a-a022-91d264183c83 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0625403 Nov 08 16:13:53.201319 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d4e919a-607c-4862-8284-1b0c23c72058 req-711003b7-f481-4539-a6d6-52859f9aabe3 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:53.202803 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2d4e919a-607c-4862-8284-1b0c23c72058 req-711003b7-f481-4539-a6d6-52859f9aabe3 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0566680 Nov 08 16:13:53.251689 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2d4e919a-607c-4862-8284-1b0c23c72058 req-20ca0d71-c4b4-4bcb-a8af-598b596f9c6b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430465 Nov 08 16:13:54.298807 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6473b7b3-8455-46e0-bf64-a373dd219dbb req-5110a11d-13a5-4945-a482-31d4cb6647ab tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:54.300294 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6473b7b3-8455-46e0-bf64-a373dd219dbb req-5110a11d-13a5-4945-a482-31d4cb6647ab tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 946 time: 0.0492113 Nov 08 16:13:54.369616 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6473b7b3-8455-46e0-bf64-a373dd219dbb req-8989d7e1-8888-406e-be10-e44dd72254b1 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0630260 Nov 08 16:13:54.390983 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4a42b06-ebd6-4d79-bbf4-f9e63564a819 req-a193f0b2-bc7e-47fc-98b5-c85e465540f6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:54.392447 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d4a42b06-ebd6-4d79-bbf4-f9e63564a819 req-a193f0b2-bc7e-47fc-98b5-c85e465540f6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0700176 Nov 08 16:13:54.438718 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d4a42b06-ebd6-4d79-bbf4-f9e63564a819 req-d1fdca8d-98a2-4aab-8fc6-08fb461620d1 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403986 Nov 08 16:13:55.127561 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 35484) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:13:55.271328 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c312e3e5-1a48-443e-bb45-fb54c5ed6808 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:55.341193 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c312e3e5-1a48-443e-bb45-fb54c5ed6808 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:55.344591 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c312e3e5-1a48-443e-bb45-fb54c5ed6808 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:55.381907 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-c312e3e5-1a48-443e-bb45-fb54c5ed6808 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=a7ce06ca221c42c8ab2c480ca6480bb6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2532222 Nov 08 16:13:55.382707 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c312e3e5-1a48-443e-bb45-fb54c5ed6808 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6498d741-4a75-43db-8085-de846153b64a,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:55.384627 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 35488) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:13:55.435261 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a7cf0887-87a6-4234-a2a5-b3434c67196e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:55.478978 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a7cf0887-87a6-4234-a2a5-b3434c67196e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:55.514440 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73ad7988-8508-45e2-ab22-f3378e5cdd6e req-9ab27de9-a0cc-4d9b-a1ae-278bb41d4418 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:55.515911 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-73ad7988-8508-45e2-ab22-f3378e5cdd6e req-9ab27de9-a0cc-4d9b-a1ae-278bb41d4418 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 946 time: 0.0764647 Nov 08 16:13:55.604777 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1262f237-ae49-460e-9545-148beef71cd4 req-a555616a-14ec-4fd1-98df-1998479939be tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:55.606266 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1262f237-ae49-460e-9545-148beef71cd4 req-a555616a-14ec-4fd1-98df-1998479939be tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0894973 Nov 08 16:13:55.610176 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-73ad7988-8508-45e2-ab22-f3378e5cdd6e req-20c94a55-bb38-49ba-a1ac-8b85036496a4 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0783412 Nov 08 16:13:55.610726 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a7cf0887-87a6-4234-a2a5-b3434c67196e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:55.613322 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a7cf0887-87a6-4234-a2a5-b3434c67196e admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:13:55.614248 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-a7cf0887-87a6-4234-a2a5-b3434c67196e admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/6498d741-4a75-43db-8085-de846153b64a HTTP/1.1" status: 204 len: 168 time: 0.2286367 Nov 08 16:13:55.636032 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7cf0887-87a6-4234-a2a5-b3434c67196e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6498d741-4a75-43db-8085-de846153b64a,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:13:55.644254 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7cf0887-87a6-4234-a2a5-b3434c67196e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:55.644605 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7cf0887-87a6-4234-a2a5-b3434c67196e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:55.644941 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7cf0887-87a6-4234-a2a5-b3434c67196e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:55.645265 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7cf0887-87a6-4234-a2a5-b3434c67196e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:55.645586 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7cf0887-87a6-4234-a2a5-b3434c67196e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:55.646644 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7cf0887-87a6-4234-a2a5-b3434c67196e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:55.646790 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7cf0887-87a6-4234-a2a5-b3434c67196e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:55.647132 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7cf0887-87a6-4234-a2a5-b3434c67196e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:55.647414 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7cf0887-87a6-4234-a2a5-b3434c67196e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:55.647723 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7cf0887-87a6-4234-a2a5-b3434c67196e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:55.648033 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7cf0887-87a6-4234-a2a5-b3434c67196e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:55.648344 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7cf0887-87a6-4234-a2a5-b3434c67196e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:13:55.679245 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1262f237-ae49-460e-9545-148beef71cd4 req-a770bc4b-cf44-4abe-887f-955cc9a77110 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0639269 Nov 08 16:13:56.727444 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b32b1ed7-8eda-4269-b4de-a173fc2e2497 req-e1057e3d-4452-441a-b447-7e6044c80d1e tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:56.728930 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b32b1ed7-8eda-4269-b4de-a173fc2e2497 req-e1057e3d-4452-441a-b447-7e6044c80d1e tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 946 time: 0.0486062 Nov 08 16:13:56.801944 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b32b1ed7-8eda-4269-b4de-a173fc2e2497 req-5f22255d-bbd9-4a47-ba0a-b699563a413f tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0671251 Nov 08 16:13:56.814884 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-262a4197-eb74-4a54-a50d-eedbb6f5d42f req-b02ffb98-40b9-4268-bf00-5542b236336b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:56.816465 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-262a4197-eb74-4a54-a50d-eedbb6f5d42f req-b02ffb98-40b9-4268-bf00-5542b236336b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0691059 Nov 08 16:13:56.866765 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-262a4197-eb74-4a54-a50d-eedbb6f5d42f req-2b0f9214-fa28-4937-9f66-5fdfb1d012cd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433185 Nov 08 16:13:57.917379 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39f1041a-ac95-4033-9196-0792b0387f16 req-1c22c6a5-5f94-421a-a645-2b8ed8689fcc tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:57.918874 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-39f1041a-ac95-4033-9196-0792b0387f16 req-1c22c6a5-5f94-421a-a645-2b8ed8689fcc tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 946 time: 0.0483038 Nov 08 16:13:57.993533 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-39f1041a-ac95-4033-9196-0792b0387f16 req-3d14afed-cf9e-4c1a-a226-0bdbe7e6721f tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0689025 Nov 08 16:13:58.007774 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b64769e-2dab-44f0-9b49-954070fc6fe8 req-4b1011db-9f6e-4672-9b74-b394cc11ac60 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:58.009198 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9b64769e-2dab-44f0-9b49-954070fc6fe8 req-4b1011db-9f6e-4672-9b74-b394cc11ac60 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0690885 Nov 08 16:13:58.054696 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9b64769e-2dab-44f0-9b49-954070fc6fe8 req-3ed2deb3-9f3d-4f7e-9a64-588612212fa0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398293 Nov 08 16:13:59.114029 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a04f6b87-b63f-4b98-a21e-8b7dc7a48d71 req-45e4f39d-41de-4b7a-8f6f-e50daecfa9a5 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:59.116120 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a04f6b87-b63f-4b98-a21e-8b7dc7a48d71 req-45e4f39d-41de-4b7a-8f6f-e50daecfa9a5 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 946 time: 0.0519547 Nov 08 16:13:59.189331 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a04f6b87-b63f-4b98-a21e-8b7dc7a48d71 req-149b71f1-0116-4e27-a33f-5235537de263 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0674443 Nov 08 16:13:59.199802 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d3773e2-2e85-44be-a743-1e0dd62a1be5 req-d943045a-861f-45a8-8deb-355d3dd1585f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:13:59.201382 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0d3773e2-2e85-44be-a743-1e0dd62a1be5 req-d943045a-861f-45a8-8deb-355d3dd1585f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0734303 Nov 08 16:13:59.249128 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0d3773e2-2e85-44be-a743-1e0dd62a1be5 req-3deb041e-7e92-4aa6-af76-22994ccc91ea tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407104 Nov 08 16:14:00.308428 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9b00a1b-88fa-46b9-b178-d8d37a86f124 req-cbb457b5-94db-48cb-a075-239e24b9ede0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:00.309921 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f9b00a1b-88fa-46b9-b178-d8d37a86f124 req-cbb457b5-94db-48cb-a075-239e24b9ede0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 946 time: 0.0536590 Nov 08 16:14:00.386889 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f9b00a1b-88fa-46b9-b178-d8d37a86f124 req-06a57c04-670e-4f3d-9911-d21fc3cc2d04 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0711596 Nov 08 16:14:00.395204 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f60fd6ee-c550-4a39-bfbc-307a9e8d1168 req-1c426f01-7461-4950-85ae-a1f491185fa9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:00.397238 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f60fd6ee-c550-4a39-bfbc-307a9e8d1168 req-1c426f01-7461-4950-85ae-a1f491185fa9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0750811 Nov 08 16:14:00.442474 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f60fd6ee-c550-4a39-bfbc-307a9e8d1168 req-f4749578-55b5-4f12-821b-3e2502850e8e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395126 Nov 08 16:14:04.171562 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e4086c9-befe-4b1d-9364-ed91c27e1f62 req-49e64291-7710-4e05-b9cf-86576f2d58e9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:04.173015 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8e4086c9-befe-4b1d-9364-ed91c27e1f62 req-49e64291-7710-4e05-b9cf-86576f2d58e9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 946 time: 0.0816207 Nov 08 16:14:04.180948 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0d1f0f4-ce14-448f-a77b-72f69dcc3e6f req-6a37c0c3-2f60-44ca-b876-83422fea875d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:04.182304 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d0d1f0f4-ce14-448f-a77b-72f69dcc3e6f req-6a37c0c3-2f60-44ca-b876-83422fea875d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0801363 Nov 08 16:14:04.251555 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8e4086c9-befe-4b1d-9364-ed91c27e1f62 req-ca21c71e-5203-4632-90d6-5cb912691afa tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0682507 Nov 08 16:14:04.254582 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d0d1f0f4-ce14-448f-a77b-72f69dcc3e6f req-d2e99a56-aaa8-4e70-ad3f-9c826ed1e973 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0658209 Nov 08 16:14:05.490378 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16e4dfc8-1769-4b8c-9de9-a4e3820feb31 req-27a9d4ce-5539-444c-9ef9-56a1f7fa68b9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:05.491832 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-16e4dfc8-1769-4b8c-9de9-a4e3820feb31 req-27a9d4ce-5539-444c-9ef9-56a1f7fa68b9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 946 time: 0.0786171 Nov 08 16:14:05.503870 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fdbc35d-cd3f-4ce8-a6cd-9d94230ff6b6 req-661ab95e-c3dc-428f-90c3-51c4ae17f234 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:05.505832 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0fdbc35d-cd3f-4ce8-a6cd-9d94230ff6b6 req-661ab95e-c3dc-428f-90c3-51c4ae17f234 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0804291 Nov 08 16:14:05.575188 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-16e4dfc8-1769-4b8c-9de9-a4e3820feb31 req-6890a868-6140-47f2-b19d-fd2a2cffc1d0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0684085 Nov 08 16:14:05.579598 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0fdbc35d-cd3f-4ce8-a6cd-9d94230ff6b6 req-1f91294e-62f0-4ac8-9c3b-6f4f8a85c183 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0672922 Nov 08 16:14:08.108509 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-87f8602a-4353-48a1-8d52-dd53e3fee7d5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:10.580671 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-9eb003b8-602b-4ef7-8a61-150780cbf619 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:10.830019 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3494ea3-53c5-4d68-8e40-d88b88b1c7f4 req-65a286d3-c665-4b31-9792-b5679b55654b tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:10.831548 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a3494ea3-53c5-4d68-8e40-d88b88b1c7f4 req-65a286d3-c665-4b31-9792-b5679b55654b tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 946 time: 0.0777159 Nov 08 16:14:10.839404 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65aec423-91be-4723-9371-cb20a9aa2cd1 req-43dbd055-da59-48f0-8c0c-3bfddb86c031 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:10.840819 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-65aec423-91be-4723-9371-cb20a9aa2cd1 req-43dbd055-da59-48f0-8c0c-3bfddb86c031 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0764325 Nov 08 16:14:10.914148 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a3494ea3-53c5-4d68-8e40-d88b88b1c7f4 req-0b0c9e34-08f2-4233-8364-595321cf42a0 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0723579 Nov 08 16:14:10.917735 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-65aec423-91be-4723-9371-cb20a9aa2cd1 req-5cc8c4ec-c52a-4658-a4c9-443c41fda1ad tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0703154 Nov 08 16:14:11.518416 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:12.063505 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d7d6d74-5cfb-475c-9d3f-9386d78dec30 req-d2c3050a-62aa-49ff-b53f-53aac404e84a tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:12.064943 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5d7d6d74-5cfb-475c-9d3f-9386d78dec30 req-d2c3050a-62aa-49ff-b53f-53aac404e84a tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 946 time: 0.0724308 Nov 08 16:14:12.092520 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef1fe9dc-ac6a-4723-b78c-6b16e71a5451 req-707eb1bf-9f15-44c4-98e0-7d713cee3333 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:12.093974 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ef1fe9dc-ac6a-4723-b78c-6b16e71a5451 req-707eb1bf-9f15-44c4-98e0-7d713cee3333 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0717537 Nov 08 16:14:12.138056 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5d7d6d74-5cfb-475c-9d3f-9386d78dec30 req-ebec4017-9fd8-43a3-9bc4-c947a40a7dcf tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0664186 Nov 08 16:14:12.158293 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ef1fe9dc-ac6a-4723-b78c-6b16e71a5451 req-c2c61869-ed02-4c03-b7de-0e502dcb7ecb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0580826 Nov 08 16:14:13.247221 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:13.952836 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:16.153890 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04ab4647-b6a2-4413-a2e5-90b602adf21c req-b5eb463f-9ea5-4f8d-bbc9-85f6705b007f tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:16.155342 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-04ab4647-b6a2-4413-a2e5-90b602adf21c req-b5eb463f-9ea5-4f8d-bbc9-85f6705b007f tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 946 time: 0.0628080 Nov 08 16:14:16.227494 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bece6140-030c-44f8-9e41-4ea1fcda3edf req-eda19396-c001-41ba-a375-07b913de237d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:16.229102 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bece6140-030c-44f8-9e41-4ea1fcda3edf req-eda19396-c001-41ba-a375-07b913de237d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0920105 Nov 08 16:14:16.232214 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-04ab4647-b6a2-4413-a2e5-90b602adf21c req-89fe614d-f4c1-43cd-8424-80ffc07654ea tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0591743 Nov 08 16:14:16.278472 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bece6140-030c-44f8-9e41-4ea1fcda3edf req-8bda6aab-c041-46f5-acf2-ed3372b4304a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429280 Nov 08 16:14:17.889483 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-8b47e6d5-9fda-4bcb-8156-7e1337ff9619 req-b223c68f-a1a4-4566-953f-1330ac8e61b0 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0384252 Nov 08 16:14:17.953964 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:17.986000 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b47e6d5-9fda-4bcb-8156-7e1337ff9619 req-c6fa3afc-6368-4859-af96-a6894f035efb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:17.987852 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-8b47e6d5-9fda-4bcb-8156-7e1337ff9619 req-c6fa3afc-6368-4859-af96-a6894f035efb service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=10a4252a63bf480d93d2e9da15bb8efd&device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 1098 time: 0.0529325 Nov 08 16:14:18.053676 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7b0a708-9d2a-4b3b-90d6-29f82c2ac0ca req-b7630d6b-4347-4934-8ffc-8e1c6c5c93b0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:18.055205 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b7b0a708-9d2a-4b3b-90d6-29f82c2ac0ca req-b7630d6b-4347-4934-8ffc-8e1c6c5c93b0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0803437 Nov 08 16:14:18.062786 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bc97322-02c1-4e34-8c59-36e98624abd9 req-147f14b2-6d1e-4a8d-8729-3a5cd1f42cb4 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:18.064179 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1bc97322-02c1-4e34-8c59-36e98624abd9 req-147f14b2-6d1e-4a8d-8729-3a5cd1f42cb4 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 946 time: 0.0808425 Nov 08 16:14:18.100937 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b47e6d5-9fda-4bcb-8156-7e1337ff9619 req-9b342b18-88ee-4611-921b-9332f2610a12 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:18.102407 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-8b47e6d5-9fda-4bcb-8156-7e1337ff9619 req-9b342b18-88ee-4611-921b-9332f2610a12 service neutron] 10.222.0.25 "GET /v2.0/networks?id=e0e08679-82fe-47eb-90b6-49a1713fdaca HTTP/1.1" status: 200 len: 918 time: 0.0865870 Nov 08 16:14:18.134347 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b7b0a708-9d2a-4b3b-90d6-29f82c2ac0ca req-cb4d1a0e-8c54-41af-a999-d3a922f91d26 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0692079 Nov 08 16:14:18.142568 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1bc97322-02c1-4e34-8c59-36e98624abd9 req-3338a6b5-3160-4da4-a520-b7d79ed5248e tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0696385 Nov 08 16:14:18.180305 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-8b47e6d5-9fda-4bcb-8156-7e1337ff9619 req-5287a274-3f8f-4de4-8f26-86dbde8bd36c service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=fbefda08-fc7a-42a0-b714-6dea3d8a5161 HTTP/1.1" status: 200 len: 1001 time: 0.0649796 Nov 08 16:14:18.234692 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b47e6d5-9fda-4bcb-8156-7e1337ff9619 req-271bdffc-c239-48e4-97d2-3f3fd35b3688 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:18.236092 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-8b47e6d5-9fda-4bcb-8156-7e1337ff9619 req-271bdffc-c239-48e4-97d2-3f3fd35b3688 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=fc52ff8b-1692-487b-a0de-f6290e65d880 HTTP/1.1" status: 200 len: 856 time: 0.0451450 Nov 08 16:14:18.307847 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b47e6d5-9fda-4bcb-8156-7e1337ff9619 req-f7936016-ceb6-40ab-a786-ed71c163e986 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:18.309272 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-8b47e6d5-9fda-4bcb-8156-7e1337ff9619 req-f7936016-ceb6-40ab-a786-ed71c163e986 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=e0e08679-82fe-47eb-90b6-49a1713fdaca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0378096 Nov 08 16:14:18.405220 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-8b47e6d5-9fda-4bcb-8156-7e1337ff9619 req-32b037da-ffb3-4b3a-a9ea-ffac669ce1a3 service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0843239 Nov 08 16:14:18.499829 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-8b47e6d5-9fda-4bcb-8156-7e1337ff9619 req-09f5e14a-08e2-467d-9924-790dd9d51c32 service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0811493 Nov 08 16:14:19.541487 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-537d38ba-b1a8-43d9-b387-abe98e64d9ed req-fe4301ef-d020-4523-bd9f-b17d92f7967f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:19.542970 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-537d38ba-b1a8-43d9-b387-abe98e64d9ed req-fe4301ef-d020-4523-bd9f-b17d92f7967f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0790086 Nov 08 16:14:19.554611 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-440313d6-b2f8-4eeb-ae69-25c6495f0460 req-e61b8eff-3494-4676-a280-3f933386ed68 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:19.555961 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-440313d6-b2f8-4eeb-ae69-25c6495f0460 req-e61b8eff-3494-4676-a280-3f933386ed68 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 946 time: 0.0669880 Nov 08 16:14:19.625939 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-537d38ba-b1a8-43d9-b387-abe98e64d9ed req-659ed61d-bddb-4587-b78f-3e8a77b965a6 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0689952 Nov 08 16:14:19.629118 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-440313d6-b2f8-4eeb-ae69-25c6495f0460 req-736170ab-d88c-481c-8d4f-66cb47eb7b14 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0668199 Nov 08 16:14:20.779527 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfb589fc-4787-405b-92cf-7cb8e1008b48 req-009badc1-232a-431d-b30f-9a384cdac4e9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:20.780909 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bfb589fc-4787-405b-92cf-7cb8e1008b48 req-009badc1-232a-431d-b30f-9a384cdac4e9 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 946 time: 0.0694096 Nov 08 16:14:20.789119 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beee598c-0ee1-4388-871e-053623892456 req-b2fd9793-69ff-4850-90d4-9e1cf1cab69f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:20.790746 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-beee598c-0ee1-4388-871e-053623892456 req-b2fd9793-69ff-4850-90d4-9e1cf1cab69f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0898159 Nov 08 16:14:20.857312 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bfb589fc-4787-405b-92cf-7cb8e1008b48 req-c683ea79-5840-4449-9757-3695623b9b33 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0656326 Nov 08 16:14:20.864321 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-beee598c-0ee1-4388-871e-053623892456 req-8e37fdfa-bc75-4fc1-ba3d-ae7780582733 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0670614 Nov 08 16:14:22.003638 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca852f3a-6046-43e0-8418-0f27034879e9 req-e8b5f325-a351-4b93-ab83-a1145d246829 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:22.005134 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ca852f3a-6046-43e0-8418-0f27034879e9 req-e8b5f325-a351-4b93-ab83-a1145d246829 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 946 time: 0.0750110 Nov 08 16:14:22.016402 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f89cbaa8-6f48-4d84-8cba-e9308e263b0a req-ed76bfa4-ef2b-45e0-aa70-de2f9d6f1813 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:22.017821 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f89cbaa8-6f48-4d84-8cba-e9308e263b0a req-ed76bfa4-ef2b-45e0-aa70-de2f9d6f1813 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0790324 Nov 08 16:14:22.093103 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ca852f3a-6046-43e0-8418-0f27034879e9 req-cabe78c2-eee7-445f-9c44-10792aafbba4 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0743337 Nov 08 16:14:22.096826 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f89cbaa8-6f48-4d84-8cba-e9308e263b0a req-a65a6bae-0f24-4015-9abe-bfe93cef16bf tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0720558 Nov 08 16:14:22.331701 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9bc93a0-967c-4896-8f26-aa985e902018 req-42be59cf-0844-4a47-ac2c-44ac6eaa8253 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:22.333698 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e9bc93a0-967c-4896-8f26-aa985e902018 req-42be59cf-0844-4a47-ac2c-44ac6eaa8253 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 945 time: 0.0503340 Nov 08 16:14:22.381476 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e9bc93a0-967c-4896-8f26-aa985e902018 req-62a82581-5196-4a5d-a18d-6a8b63ed4693 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418003 Nov 08 16:14:23.222131 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90b5350e-7f74-48f4-b1ab-2799e6d927c5 req-f91b4254-7226-4d98-b8c7-5c51c81cd750 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:23.223683 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-90b5350e-7f74-48f4-b1ab-2799e6d927c5 req-f91b4254-7226-4d98-b8c7-5c51c81cd750 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0563991 Nov 08 16:14:23.298929 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-90b5350e-7f74-48f4-b1ab-2799e6d927c5 req-a54b0aac-05b3-40cd-bcc4-e6fadb79cb4b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0640576 Nov 08 16:14:23.310019 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c465d2b-9034-413b-a75c-a6f12c8522f9 req-bd1b4a15-7c27-4cd3-93c5-09768a740475 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:23.311337 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0c465d2b-9034-413b-a75c-a6f12c8522f9 req-bd1b4a15-7c27-4cd3-93c5-09768a740475 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 946 time: 0.0845890 Nov 08 16:14:23.358099 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0c465d2b-9034-413b-a75c-a6f12c8522f9 req-5589b047-3ec7-4c09-87d6-d5d5caea1e0b tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407639 Nov 08 16:14:23.494742 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a983d6fa-319d-4834-b38c-83e765c3aa74 req-1a7a6315-8f74-4b0c-af25-8bd7d499fc7e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:23.496173 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a983d6fa-319d-4834-b38c-83e765c3aa74 req-1a7a6315-8f74-4b0c-af25-8bd7d499fc7e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 945 time: 0.0485795 Nov 08 16:14:23.543171 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a983d6fa-319d-4834-b38c-83e765c3aa74 req-67cfbfff-21b3-408b-9b6f-6b236ec20847 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408816 Nov 08 16:14:23.604999 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:14:24.414612 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84ce5f19-bbc1-430d-8a22-c674708342db req-9c869e70-ff09-4bc6-a59c-e58bad88a42d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:24.416592 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-84ce5f19-bbc1-430d-8a22-c674708342db req-9c869e70-ff09-4bc6-a59c-e58bad88a42d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0490327 Nov 08 16:14:24.500057 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-84ce5f19-bbc1-430d-8a22-c674708342db req-650c6af2-dada-4a7a-8901-4e45d0ccaa6c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0780065 Nov 08 16:14:24.512024 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d653772-01d1-45b9-a712-5884847cde67 req-f3130a03-3168-4a36-b48b-9e5a61ab7150 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:24.513460 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8d653772-01d1-45b9-a712-5884847cde67 req-f3130a03-3168-4a36-b48b-9e5a61ab7150 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 946 time: 0.0682507 Nov 08 16:14:24.558929 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8d653772-01d1-45b9-a712-5884847cde67 req-b41b1de5-5b8f-483d-a69f-ae54cd2d008d tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394967 Nov 08 16:14:24.656670 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15c7d987-e88e-4076-bc18-9c9353f2a62e req-556a79d0-a6a4-4c22-b702-35c49675dfef tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:24.658194 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-15c7d987-e88e-4076-bc18-9c9353f2a62e req-556a79d0-a6a4-4c22-b702-35c49675dfef tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 945 time: 0.0480087 Nov 08 16:14:24.705275 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-15c7d987-e88e-4076-bc18-9c9353f2a62e req-9e24227a-b86b-4f46-98a1-b3959c7ce90b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412049 Nov 08 16:14:24.884099 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 35922) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:14:24.986132 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b70d6e9c-efb5-475e-b259-f8b95149a6c3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:25.061865 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b70d6e9c-efb5-475e-b259-f8b95149a6c3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:25.066810 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b70d6e9c-efb5-475e-b259-f8b95149a6c3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:25.111020 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-b70d6e9c-efb5-475e-b259-f8b95149a6c3 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=91b6eb75031f4a718b8ecfe9e509fe6e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2212636 Nov 08 16:14:25.111020 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b70d6e9c-efb5-475e-b259-f8b95149a6c3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f26a0252-00ad-4a4a-ae3f-568188fc2926,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:14:25.111513 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 35930) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:14:25.158712 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-385ea23f-00ac-42fa-a6d4-5079a68ef2b7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:25.179771 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-385ea23f-00ac-42fa-a6d4-5079a68ef2b7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:25.231745 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-385ea23f-00ac-42fa-a6d4-5079a68ef2b7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:25.234269 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-385ea23f-00ac-42fa-a6d4-5079a68ef2b7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:25.235314 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-385ea23f-00ac-42fa-a6d4-5079a68ef2b7 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/f26a0252-00ad-4a4a-ae3f-568188fc2926 HTTP/1.1" status: 204 len: 168 time: 0.1221972 Nov 08 16:14:25.484517 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-385ea23f-00ac-42fa-a6d4-5079a68ef2b7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f26a0252-00ad-4a4a-ae3f-568188fc2926,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:14:25.495738 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-385ea23f-00ac-42fa-a6d4-5079a68ef2b7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:14:25.496067 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-385ea23f-00ac-42fa-a6d4-5079a68ef2b7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:14:25.496457 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-385ea23f-00ac-42fa-a6d4-5079a68ef2b7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:14:25.496771 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-385ea23f-00ac-42fa-a6d4-5079a68ef2b7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:14:25.497023 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-385ea23f-00ac-42fa-a6d4-5079a68ef2b7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:14:25.497608 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-385ea23f-00ac-42fa-a6d4-5079a68ef2b7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:14:25.497956 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-385ea23f-00ac-42fa-a6d4-5079a68ef2b7 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:14:25.498280 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-385ea23f-00ac-42fa-a6d4-5079a68ef2b7 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:14:25.498643 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-385ea23f-00ac-42fa-a6d4-5079a68ef2b7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:14:25.498902 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-385ea23f-00ac-42fa-a6d4-5079a68ef2b7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:14:25.499218 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-385ea23f-00ac-42fa-a6d4-5079a68ef2b7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:14:25.499530 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-385ea23f-00ac-42fa-a6d4-5079a68ef2b7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:14:25.517552 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-880817ef-2bea-4d20-a916-cd95e3e5eb00 req-13442aaa-979a-4049-a49e-6c28a047749b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:25.519076 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-880817ef-2bea-4d20-a916-cd95e3e5eb00 req-13442aaa-979a-4049-a49e-6c28a047749b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.25 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 945 time: 0.2953804 Nov 08 16:14:25.631182 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [req-880817ef-2bea-4d20-a916-cd95e3e5eb00 req-76e0b56f-d911-48fd-9065-74ba5f033e28 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Deleting port f47160fc-9457-4c27-a7dc-b4b4b112f9b1 {{(pid=101245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:14:25.631505 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-880817ef-2bea-4d20-a916-cd95e3e5eb00 req-76e0b56f-d911-48fd-9065-74ba5f033e28 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:25.633426 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5ed1d2d-129e-4eaf-a56c-e5d005838723 req-f8765a89-c845-4163-b472-2c291c41dd13 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:25.635116 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e5ed1d2d-129e-4eaf-a56c-e5d005838723 req-f8765a89-c845-4163-b472-2c291c41dd13 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0588622 Nov 08 16:14:25.733651 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07b74b2f-9b93-4951-a279-764fb72a7dfb req-1fa37e15-e52a-4314-b23b-f1edcb53db01 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:25.735450 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-07b74b2f-9b93-4951-a279-764fb72a7dfb req-1fa37e15-e52a-4314-b23b-f1edcb53db01 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 946 time: 0.0910916 Nov 08 16:14:25.739702 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e5ed1d2d-129e-4eaf-a56c-e5d005838723 req-3b8cd1d2-acd2-49fc-83c2-37eb6aaa4e98 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0975716 Nov 08 16:14:25.740771 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [req-880817ef-2bea-4d20-a916-cd95e3e5eb00 req-76e0b56f-d911-48fd-9065-74ba5f033e28 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] For port f47160fc-9457-4c27-a7dc-b4b4b112f9b1, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=f47160fc-9457-4c27-a7dc-b4b4b112f9b1,segment=NetworkSegment(fab7ad78-c438-48e7-8fdb-80ff50b8600c),segment_id=fab7ad78-c438-48e7-8fdb-80ff50b8600c)] {{(pid=101245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:14:25.741204 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-880817ef-2bea-4d20-a916-cd95e3e5eb00 req-76e0b56f-d911-48fd-9065-74ba5f033e28 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:25.760771 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [req-880817ef-2bea-4d20-a916-cd95e3e5eb00 req-76e0b56f-d911-48fd-9065-74ba5f033e28 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling delete_port for f47160fc-9457-4c27-a7dc-b4b4b112f9b1 owned by compute:nova {{(pid=101245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:14:25.866781 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-07b74b2f-9b93-4951-a279-764fb72a7dfb req-90a1a6ed-a5cc-404e-9478-d4e33d67485a tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/security-groups?id=7980e368-4ba2-4f63-995b-685d9baec7a2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1161702 Nov 08 16:14:25.907025 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49598ed6-a24c-40b7-b5d5-f8075debed97 req-e62c6ecb-6ef6-451e-ae0e-5796c5ef7bc8 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:25.908552 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-49598ed6-a24c-40b7-b5d5-f8075debed97 req-e62c6ecb-6ef6-451e-ae0e-5796c5ef7bc8 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.25 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 946 time: 0.1344011 Nov 08 16:14:25.919549 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0fb7975-edcb-47d0-8828-e3151a709661 req-66c7d551-5722-4bcd-a8db-a2e6cbe66e67 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:25.921537 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b0fb7975-edcb-47d0-8828-e3151a709661 req-66c7d551-5722-4bcd-a8db-a2e6cbe66e67 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=cf462447-a55a-46b8-9afd-afca942aa011 HTTP/1.1" status: 200 len: 945 time: 0.0943856 Nov 08 16:14:25.951991 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-880817ef-2bea-4d20-a916-cd95e3e5eb00 req-76e0b56f-d911-48fd-9065-74ba5f033e28 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:25.967201 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['4020a644-ef2e-4dd8-931a-cfccef4e7b15', 'd14efac8-b33a-4eb0-b610-32a9bf41b972', 'b2d31fb8-0a87-4aea-8200-914cd468d395', 'f47160fc-9457-4c27-a7dc-b4b4b112f9b1'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:14:25.985617 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76e0b56f-d911-48fd-9065-74ba5f033e28 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Pushing event deleted for resources: {'Port': ['ID=f47160fc-9457-4c27-a7dc-b4b4b112f9b1,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:14:26.025642 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [req-880817ef-2bea-4d20-a916-cd95e3e5eb00 req-76e0b56f-d911-48fd-9065-74ba5f033e28 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] No DVR routers for this DVR port f47160fc-9457-4c27-a7dc-b4b4b112f9b1 on host hv-cinder-81618 {{(pid=101245) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:14:26.028790 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-880817ef-2bea-4d20-a916-cd95e3e5eb00 req-76e0b56f-d911-48fd-9065-74ba5f033e28 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:26.032166 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-880817ef-2bea-4d20-a916-cd95e3e5eb00 req-76e0b56f-d911-48fd-9065-74ba5f033e28 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.25 "DELETE /v2.0/ports/f47160fc-9457-4c27-a7dc-b4b4b112f9b1 HTTP/1.1" status: 204 len: 173 time: 0.5048385 Nov 08 16:14:26.032618 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cf462447-a55a-46b8-9afd-afca942aa011', 'name': 'network-vif-deleted', 'tag': 'f47160fc-9457-4c27-a7dc-b4b4b112f9b1'}] {{(pid=101245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:14:26.033641 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b0fb7975-edcb-47d0-8828-e3151a709661 req-0754c9f9-4c4d-49f1-9e6b-ffcba36850f1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0857148 Nov 08 16:14:26.034901 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9303bddee447de525cefc409d3d14f9dbe8ef1f21bfe9eb24fdef2609d4aa3c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-32b57833-d0fb-4ee9-ac60-b28d09d8cfc8" -d '{"events": [{"server_uuid": "cf462447-a55a-46b8-9afd-afca942aa011", "name": "network-vif-deleted", "tag": "f47160fc-9457-4c27-a7dc-b4b4b112f9b1"}]}' {{(pid=101245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:14:26.084706 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:14:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d8f5d70f-324e-4e6f-bd90-025c2c323fde x-openstack-request-id: req-d8f5d70f-324e-4e6f-bd90-025c2c323fde {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:14:26.084969 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cf462447-a55a-46b8-9afd-afca942aa011", "name": "network-vif-deleted", "tag": "f47160fc-9457-4c27-a7dc-b4b4b112f9b1", "status": "completed", "code": 200}]} {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:14:26.085218 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-d8f5d70f-324e-4e6f-bd90-025c2c323fde {{(pid=101245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:14:26.085701 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cf462447-a55a-46b8-9afd-afca942aa011', 'name': 'network-vif-deleted', 'tag': 'f47160fc-9457-4c27-a7dc-b4b4b112f9b1', 'status': 'completed', 'code': 200} Nov 08 16:14:26.088349 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-49598ed6-a24c-40b7-b5d5-f8075debed97 req-903b20ac-68e9-42db-b3a1-9a7a5d219fd6 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Deleting port 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:14:26.088349 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-49598ed6-a24c-40b7-b5d5-f8075debed97 req-903b20ac-68e9-42db-b3a1-9a7a5d219fd6 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:26.202689 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-49598ed6-a24c-40b7-b5d5-f8075debed97 req-903b20ac-68e9-42db-b3a1-9a7a5d219fd6 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] For port 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e,segment=NetworkSegment(4d73fdfb-694f-4679-be5c-5e9ca8483c31),segment_id=4d73fdfb-694f-4679-be5c-5e9ca8483c31)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:14:26.203173 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-49598ed6-a24c-40b7-b5d5-f8075debed97 req-903b20ac-68e9-42db-b3a1-9a7a5d219fd6 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:26.222363 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-49598ed6-a24c-40b7-b5d5-f8075debed97 req-903b20ac-68e9-42db-b3a1-9a7a5d219fd6 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Calling delete_port for 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e owned by compute:nova {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:14:26.385927 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-49598ed6-a24c-40b7-b5d5-f8075debed97 req-903b20ac-68e9-42db-b3a1-9a7a5d219fd6 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:26.414925 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-903b20ac-68e9-42db-b3a1-9a7a5d219fd6 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Pushing event deleted for resources: {'Port': ['ID=2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:14:26.457894 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-49598ed6-a24c-40b7-b5d5-f8075debed97 req-903b20ac-68e9-42db-b3a1-9a7a5d219fd6 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] No DVR routers for this DVR port 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e on host hv-cinder-81618 {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:14:26.460404 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-49598ed6-a24c-40b7-b5d5-f8075debed97 req-903b20ac-68e9-42db-b3a1-9a7a5d219fd6 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:26.463993 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-49598ed6-a24c-40b7-b5d5-f8075debed97 req-903b20ac-68e9-42db-b3a1-9a7a5d219fd6 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.25 "DELETE /v2.0/ports/2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e HTTP/1.1" status: 204 len: 173 time: 0.5419676 Nov 08 16:14:26.464424 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '37e5636f-2ecf-4438-8be2-e973029678a1', 'name': 'network-vif-deleted', 'tag': '2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:14:26.466707 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dc72ee62-d96a-4d75-a0fe-2a0b80468e12" -d '{"events": [{"server_uuid": "37e5636f-2ecf-4438-8be2-e973029678a1", "name": "network-vif-deleted", "tag": "2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:14:26.518355 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:14:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-828455df-bbb6-4dcd-866c-17115fdc88e9 x-openstack-request-id: req-828455df-bbb6-4dcd-866c-17115fdc88e9 {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:14:26.518653 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "37e5636f-2ecf-4438-8be2-e973029678a1", "name": "network-vif-deleted", "tag": "2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:14:26.518905 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-828455df-bbb6-4dcd-866c-17115fdc88e9 {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:14:26.519302 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '37e5636f-2ecf-4438-8be2-e973029678a1', 'name': 'network-vif-deleted', 'tag': '2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e', 'status': 'completed', 'code': 200} Nov 08 16:14:26.857980 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad3c912f-b97c-4185-b6fd-65edb63ac2bd req-508145e1-d38e-4b6e-ae29-c4b18b77d45e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:26.859339 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ad3c912f-b97c-4185-b6fd-65edb63ac2bd req-508145e1-d38e-4b6e-ae29-c4b18b77d45e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0478127 Nov 08 16:14:26.908577 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ad3c912f-b97c-4185-b6fd-65edb63ac2bd req-9fa817d5-b9cc-4ed1-b3da-7b52650d6bfb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435014 Nov 08 16:14:26.964577 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-10b71dea-7dec-458a-be47-ebd6bde874a3 req-d7ea2bca-dc8a-45b7-a273-36d5ebe8b7e8 tempest-VolumesActionsTest-1501559562 tempest-VolumesActionsTest-1501559562-project] 10.222.0.37 "GET /v2.0/ports?device_id=37e5636f-2ecf-4438-8be2-e973029678a1 HTTP/1.1" status: 200 len: 210 time: 0.0255196 Nov 08 16:14:28.036961 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49603019-6868-4451-98bc-3a74302b0148 req-a180b419-a24f-468f-aebe-54835cce3f7d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:28.038485 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-49603019-6868-4451-98bc-3a74302b0148 req-a180b419-a24f-468f-aebe-54835cce3f7d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0516946 Nov 08 16:14:28.092094 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-49603019-6868-4451-98bc-3a74302b0148 req-08ea8377-f68f-45bd-a7c9-9df032e4ba20 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476301 Nov 08 16:14:28.113863 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:14:28.136258 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] No Port match for: 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:14:28.136681 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 2f3b8f75-7e1d-43bb-b0d0-c6fb1eb96e1e not bound to the agent host hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:14:28.137293 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device f47160fc-9457-4c27-a7dc-b4b4b112f9b1 no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:14:28.157997 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] No Port match for: f47160fc-9457-4c27-a7dc-b4b4b112f9b1 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:14:28.158338 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device f47160fc-9457-4c27-a7dc-b4b4b112f9b1 not bound to the agent host hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:14:28.522184 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faa0dad0-c54b-431a-96c3-2a75cad78dc6 req-c965de78-2ddf-4049-bcb7-bdf8f5c10f1a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:28.523142 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-faa0dad0-c54b-431a-96c3-2a75cad78dc6 req-c965de78-2ddf-4049-bcb7-bdf8f5c10f1a tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=1400ac35-c2ae-4814-ac9b-d18094175dce HTTP/1.1" status: 200 len: 945 time: 0.0544724 Nov 08 16:14:28.570351 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-faa0dad0-c54b-431a-96c3-2a75cad78dc6 req-516a18ee-794c-44b0-8a83-ac2d064dc5e4 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411711 Nov 08 16:14:29.037012 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9fdbd8c-9939-470a-b997-331e7655b862 req-b160bcf7-637c-4613-838a-0d43e6f7ac8b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:29.038541 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c9fdbd8c-9939-470a-b997-331e7655b862 req-b160bcf7-637c-4613-838a-0d43e6f7ac8b service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 1098 time: 0.0427556 Nov 08 16:14:29.087105 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c9fdbd8c-9939-470a-b997-331e7655b862 req-db2e4360-1de9-4f40-a0e9-48d855df71ba service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397477 Nov 08 16:14:29.206029 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55f7dfc7-8250-4464-b125-c7fbf3a842d2 req-4c794a02-0570-4c03-a269-4c21baebcb71 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:29.207988 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-55f7dfc7-8250-4464-b125-c7fbf3a842d2 req-4c794a02-0570-4c03-a269-4c21baebcb71 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0474341 Nov 08 16:14:29.252992 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-55f7dfc7-8250-4464-b125-c7fbf3a842d2 req-36088ffc-c9db-4bbb-aafa-6187ed533a2b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394306 Nov 08 16:14:33.368183 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b59551d-a44a-4e43-a621-10ab58d71c89 req-8cc0c4f6-3d99-482a-9e9a-529e284f70c8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:33.369562 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0b59551d-a44a-4e43-a621-10ab58d71c89 req-8cc0c4f6-3d99-482a-9e9a-529e284f70c8 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0698819 Nov 08 16:14:33.377291 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f12dd93-292a-4151-98dd-8ffff6bfc0be req-bc975288-783f-4232-ba8f-6cb0ed9cadcd tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:33.379229 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1f12dd93-292a-4151-98dd-8ffff6bfc0be req-bc975288-783f-4232-ba8f-6cb0ed9cadcd tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=1400ac35-c2ae-4814-ac9b-d18094175dce HTTP/1.1" status: 200 len: 945 time: 0.0887239 Nov 08 16:14:33.448552 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0b59551d-a44a-4e43-a621-10ab58d71c89 req-92ab23e7-bf6a-4665-9cf3-3b73ce2c9e38 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0683804 Nov 08 16:14:33.451982 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1f12dd93-292a-4151-98dd-8ffff6bfc0be req-5f24e308-f4fc-4911-bd4d-cebff6b8993b tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0662339 Nov 08 16:14:38.090679 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3f3331d-27ef-4506-b7c6-de41ec627213 req-81649879-1565-4ebb-8d19-b5587fc7e033 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:38.092159 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b3f3331d-27ef-4506-b7c6-de41ec627213 req-81649879-1565-4ebb-8d19-b5587fc7e033 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0759985 Nov 08 16:14:38.100418 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0bfd9a3-9812-4db7-a2cd-7e128d418cfa req-c14453f9-81fa-47f2-8ec3-ca2ef2b2912e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:38.101929 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d0bfd9a3-9812-4db7-a2cd-7e128d418cfa req-c14453f9-81fa-47f2-8ec3-ca2ef2b2912e tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=1400ac35-c2ae-4814-ac9b-d18094175dce HTTP/1.1" status: 200 len: 945 time: 0.0765698 Nov 08 16:14:38.110350 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-a396dd0b-b420-4b1b-9e20-91864c42c9d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:38.173103 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b3f3331d-27ef-4506-b7c6-de41ec627213 req-c4c05f95-f4d5-4f9f-a1a0-80a99c72fd27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0701318 Nov 08 16:14:38.180432 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d0bfd9a3-9812-4db7-a2cd-7e128d418cfa req-f41167de-5aab-435d-b950-972efcec5b31 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0706100 Nov 08 16:14:39.390537 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9238ba0-522e-4069-b129-84087f3c76f2 req-0b14947f-4ec6-4a4d-9d85-57403629498f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:39.391974 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a9238ba0-522e-4069-b129-84087f3c76f2 req-0b14947f-4ec6-4a4d-9d85-57403629498f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0481429 Nov 08 16:14:39.437228 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a9238ba0-522e-4069-b129-84087f3c76f2 req-b302ae94-ad07-43f6-ad69-e021acc83fba tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394728 Nov 08 16:14:39.536102 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb5b732f-93fd-4db4-8076-82e608bb9c6d req-270aff34-d01d-46db-a6ee-906c8b50ae19 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:39.537540 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cb5b732f-93fd-4db4-8076-82e608bb9c6d req-270aff34-d01d-46db-a6ee-906c8b50ae19 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=1400ac35-c2ae-4814-ac9b-d18094175dce HTTP/1.1" status: 200 len: 945 time: 0.0468276 Nov 08 16:14:39.581634 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cb5b732f-93fd-4db4-8076-82e608bb9c6d req-468c4a14-9e5d-4ddc-9fd7-84c7c5882093 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384414 Nov 08 16:14:39.857800 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d03d3110-ebcc-496c-981f-73da263ce2cd req-70ba25cb-6a6b-461d-a36d-b3627b32676d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:39.859250 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d03d3110-ebcc-496c-981f-73da263ce2cd req-70ba25cb-6a6b-461d-a36d-b3627b32676d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0516703 Nov 08 16:14:39.904272 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d03d3110-ebcc-496c-981f-73da263ce2cd req-88934198-9120-4e9a-b022-1cd2769ef2e2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393252 Nov 08 16:14:40.581808 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea407911-967b-4af8-a003-d2a62045216d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:40.694358 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd9d8e06-de17-4606-a1d0-8eae6b8c3f21 req-83663af3-1ad6-4aa0-91b0-345702c40ae1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:40.695794 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fd9d8e06-de17-4606-a1d0-8eae6b8c3f21 req-83663af3-1ad6-4aa0-91b0-345702c40ae1 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=1400ac35-c2ae-4814-ac9b-d18094175dce HTTP/1.1" status: 200 len: 945 time: 0.0471032 Nov 08 16:14:40.740011 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fd9d8e06-de17-4606-a1d0-8eae6b8c3f21 req-e60507eb-7ef2-455f-a357-60d189543dd6 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384071 Nov 08 16:14:41.522732 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:42.882064 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9faf1242-d19b-4d07-b04f-e8d811857367 req-e497989d-d049-4a7d-ad3b-c19525fa4258 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:42.883700 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9faf1242-d19b-4d07-b04f-e8d811857367 req-e497989d-d049-4a7d-ad3b-c19525fa4258 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=4818358a827143eb9ace58a26713cdf0&device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 1098 time: 0.0447953 Nov 08 16:14:43.241261 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb1f85f9-5368-434b-be56-4d990c47dbe9 req-2c809475-e10f-4f01-abae-9b88a7109690 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:43.242775 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-eb1f85f9-5368-434b-be56-4d990c47dbe9 req-2c809475-e10f-4f01-abae-9b88a7109690 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=1400ac35-c2ae-4814-ac9b-d18094175dce HTTP/1.1" status: 200 len: 945 time: 0.1278257 Nov 08 16:14:43.251495 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:43.252922 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff582879-397a-4254-9b10-adef78f70f07 req-514bbfeb-245f-44a1-976f-5bdede21a055 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:43.254433 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ff582879-397a-4254-9b10-adef78f70f07 req-514bbfeb-245f-44a1-976f-5bdede21a055 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.1405952 Nov 08 16:14:43.264833 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9faf1242-d19b-4d07-b04f-e8d811857367 req-0f2a16c8-3b19-4afe-99e3-3c83fdf30a78 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:43.266277 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9faf1242-d19b-4d07-b04f-e8d811857367 req-0f2a16c8-3b19-4afe-99e3-3c83fdf30a78 service neutron] 10.222.0.25 "GET /v2.0/networks?id=2d5b5768-37f3-49a1-b451-2803f6f97429 HTTP/1.1" status: 200 len: 919 time: 0.3711071 Nov 08 16:14:43.330955 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9faf1242-d19b-4d07-b04f-e8d811857367 req-5728a77a-2cb5-4174-95a6-d36cfd3f724f service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=17db566c-bf28-4091-b7f6-4ffa5f80c982 HTTP/1.1" status: 200 len: 217 time: 0.0517468 Nov 08 16:14:43.388503 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-eb1f85f9-5368-434b-be56-4d990c47dbe9 req-f9416f15-29bd-41e5-b445-99f0686d658c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1331220 Nov 08 16:14:43.396169 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ff582879-397a-4254-9b10-adef78f70f07 req-176b1445-d03b-4200-aae7-0bf9ae748e6d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1325707 Nov 08 16:14:43.413542 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9faf1242-d19b-4d07-b04f-e8d811857367 req-f25c7cab-7d77-4aea-9cd9-fd8d69ddcd75 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:43.413542 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9faf1242-d19b-4d07-b04f-e8d811857367 req-f25c7cab-7d77-4aea-9cd9-fd8d69ddcd75 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=6936707c-bd3f-4cd8-9462-a4af0ea16ed8 HTTP/1.1" status: 200 len: 858 time: 0.0686052 Nov 08 16:14:43.444678 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9faf1242-d19b-4d07-b04f-e8d811857367 req-a5c6448f-b2e0-4642-ba7a-adf45d8be6e9 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=2d5b5768-37f3-49a1-b451-2803f6f97429&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0233364 Nov 08 16:14:43.534104 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9faf1242-d19b-4d07-b04f-e8d811857367 req-5b8cda38-a5c3-446a-ba33-ff449e07e823 service neutron] 10.222.0.25 "GET /v2.0/networks/2d5b5768-37f3-49a1-b451-2803f6f97429?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0816858 Nov 08 16:14:43.620054 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9faf1242-d19b-4d07-b04f-e8d811857367 req-f891868d-9eee-476a-b094-86d7d0e829f6 service neutron] 10.222.0.25 "GET /v2.0/networks/2d5b5768-37f3-49a1-b451-2803f6f97429?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0784636 Nov 08 16:14:43.865060 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97ec5c68-b74a-4fcc-8cc5-e4966b4ecf74 req-08ceaa1e-ad33-4610-9af6-096d1bf6c82c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:43.866429 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-97ec5c68-b74a-4fcc-8cc5-e4966b4ecf74 req-08ceaa1e-ad33-4610-9af6-096d1bf6c82c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.25 "GET /v2.0/ports?device_id=1400ac35-c2ae-4814-ac9b-d18094175dce HTTP/1.1" status: 200 len: 945 time: 0.0479577 Nov 08 16:14:43.953365 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:43.967434 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-97ec5c68-b74a-4fcc-8cc5-e4966b4ecf74 req-3256fc95-9c78-459d-9f38-4dfc6f7bb530 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Deleting port b2d31fb8-0a87-4aea-8200-914cd468d395 {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:14:43.967966 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-97ec5c68-b74a-4fcc-8cc5-e4966b4ecf74 req-3256fc95-9c78-459d-9f38-4dfc6f7bb530 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:44.055406 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-97ec5c68-b74a-4fcc-8cc5-e4966b4ecf74 req-3256fc95-9c78-459d-9f38-4dfc6f7bb530 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] For port b2d31fb8-0a87-4aea-8200-914cd468d395, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=b2d31fb8-0a87-4aea-8200-914cd468d395,segment=NetworkSegment(fab7ad78-c438-48e7-8fdb-80ff50b8600c),segment_id=fab7ad78-c438-48e7-8fdb-80ff50b8600c)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:14:44.055758 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-97ec5c68-b74a-4fcc-8cc5-e4966b4ecf74 req-3256fc95-9c78-459d-9f38-4dfc6f7bb530 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:44.068743 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-97ec5c68-b74a-4fcc-8cc5-e4966b4ecf74 req-3256fc95-9c78-459d-9f38-4dfc6f7bb530 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling delete_port for b2d31fb8-0a87-4aea-8200-914cd468d395 owned by compute:nova {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:14:44.193815 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-97ec5c68-b74a-4fcc-8cc5-e4966b4ecf74 req-3256fc95-9c78-459d-9f38-4dfc6f7bb530 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:44.209022 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['4020a644-ef2e-4dd8-931a-cfccef4e7b15', 'd14efac8-b33a-4eb0-b610-32a9bf41b972', 'b2d31fb8-0a87-4aea-8200-914cd468d395'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:14:44.220592 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3256fc95-9c78-459d-9f38-4dfc6f7bb530 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Pushing event deleted for resources: {'Port': ['ID=b2d31fb8-0a87-4aea-8200-914cd468d395,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:14:44.265960 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-97ec5c68-b74a-4fcc-8cc5-e4966b4ecf74 req-3256fc95-9c78-459d-9f38-4dfc6f7bb530 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] No DVR routers for this DVR port b2d31fb8-0a87-4aea-8200-914cd468d395 on host hv-cinder-81618 {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:14:44.268969 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-97ec5c68-b74a-4fcc-8cc5-e4966b4ecf74 req-3256fc95-9c78-459d-9f38-4dfc6f7bb530 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:44.272247 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-97ec5c68-b74a-4fcc-8cc5-e4966b4ecf74 req-3256fc95-9c78-459d-9f38-4dfc6f7bb530 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.25 "DELETE /v2.0/ports/b2d31fb8-0a87-4aea-8200-914cd468d395 HTTP/1.1" status: 204 len: 173 time: 0.3972316 Nov 08 16:14:44.272690 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1400ac35-c2ae-4814-ac9b-d18094175dce', 'name': 'network-vif-deleted', 'tag': 'b2d31fb8-0a87-4aea-8200-914cd468d395'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:14:44.275330 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e9bbd5f9-09b6-4486-9e4c-c1616cc1a044" -d '{"events": [{"server_uuid": "1400ac35-c2ae-4814-ac9b-d18094175dce", "name": "network-vif-deleted", "tag": "b2d31fb8-0a87-4aea-8200-914cd468d395"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:14:44.313129 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:14:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-128cfe6a-fe0c-41c5-a791-6eb1bfd97e82 x-openstack-request-id: req-128cfe6a-fe0c-41c5-a791-6eb1bfd97e82 {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:14:44.314125 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1400ac35-c2ae-4814-ac9b-d18094175dce", "name": "network-vif-deleted", "tag": "b2d31fb8-0a87-4aea-8200-914cd468d395", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:14:44.314387 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-128cfe6a-fe0c-41c5-a791-6eb1bfd97e82 {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:14:44.314791 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1400ac35-c2ae-4814-ac9b-d18094175dce', 'name': 'network-vif-deleted', 'tag': 'b2d31fb8-0a87-4aea-8200-914cd468d395', 'status': 'completed', 'code': 200} Nov 08 16:14:44.509469 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3f49ea1b-b224-44fe-a2df-350d298e95d1 req-ee94b81b-5d41-4c71-a634-afb19f6aee61 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=1400ac35-c2ae-4814-ac9b-d18094175dce HTTP/1.1" status: 200 len: 210 time: 0.0325093 Nov 08 16:14:44.556738 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-288c6094-6575-4a81-8d0c-cdba2f69ef00 req-cc9c5a56-682b-4c7b-a9e3-535363481964 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:44.558195 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-288c6094-6575-4a81-8d0c-cdba2f69ef00 req-cc9c5a56-682b-4c7b-a9e3-535363481964 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0520561 Nov 08 16:14:44.606902 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-288c6094-6575-4a81-8d0c-cdba2f69ef00 req-ccbdc19b-4565-4167-89db-44973937c09f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430374 Nov 08 16:14:45.958773 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14df833a-4fca-4e87-bd2e-df49bf5e17cb req-be957195-be09-4f79-98e6-90ffe6bd175b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:45.962597 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-14df833a-4fca-4e87-bd2e-df49bf5e17cb req-be957195-be09-4f79-98e6-90ffe6bd175b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0735319 Nov 08 16:14:46.003104 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 36320) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:14:46.026391 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-14df833a-4fca-4e87-bd2e-df49bf5e17cb req-31dd2dc6-135d-4be0-bad2-1e7459443860 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0574887 Nov 08 16:14:46.170997 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-870143f4-186c-4ad4-affe-c6a7d4166a19 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:46.186177 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24945ac7-3dc8-4f76-87fa-b3cee0eb13e2 req-850c27a9-1758-4a5f-978c-595584cf9147 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:46.187704 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-24945ac7-3dc8-4f76-87fa-b3cee0eb13e2 req-850c27a9-1758-4a5f-978c-595584cf9147 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=333fb179-0416-4534-95d0-4d9f3a9478f0 HTTP/1.1" status: 200 len: 945 time: 0.0629876 Nov 08 16:14:46.221371 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device b2d31fb8-0a87-4aea-8200-914cd468d395 no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:14:46.262061 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-24945ac7-3dc8-4f76-87fa-b3cee0eb13e2 req-dbc1cb74-c828-43db-922a-98726d479c78 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0671179 Nov 08 16:14:46.275616 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] No Port match for: b2d31fb8-0a87-4aea-8200-914cd468d395 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:14:46.275963 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device b2d31fb8-0a87-4aea-8200-914cd468d395 not bound to the agent host hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:14:46.309300 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-870143f4-186c-4ad4-affe-c6a7d4166a19 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:46.314768 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-870143f4-186c-4ad4-affe-c6a7d4166a19 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:46.366514 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-870143f4-186c-4ad4-affe-c6a7d4166a19 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=cb8c9a996a3a4691a0a0a4323f3cdb1a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3599725 Nov 08 16:14:46.366514 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-870143f4-186c-4ad4-affe-c6a7d4166a19 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9dadd14e-599e-4234-b0f0-954262bf5b68,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:14:46.367225 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 36330) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:14:46.422064 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-1d8a6961-de02-42fa-baa5-d7ec4126adbf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:46.445610 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-1d8a6961-de02-42fa-baa5-d7ec4126adbf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:46.506531 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-1d8a6961-de02-42fa-baa5-d7ec4126adbf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:46.515584 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-1d8a6961-de02-42fa-baa5-d7ec4126adbf admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:46.515584 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-1d8a6961-de02-42fa-baa5-d7ec4126adbf admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/9dadd14e-599e-4234-b0f0-954262bf5b68 HTTP/1.1" status: 204 len: 168 time: 0.1430669 Nov 08 16:14:46.522856 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d8a6961-de02-42fa-baa5-d7ec4126adbf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9dadd14e-599e-4234-b0f0-954262bf5b68,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:14:47.181138 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c68973e0-41ea-46ca-a4ba-21137d5160d8 req-300b2d99-213b-4378-81e2-13f9c7516097 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:47.182993 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c68973e0-41ea-46ca-a4ba-21137d5160d8 req-300b2d99-213b-4378-81e2-13f9c7516097 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0600407 Nov 08 16:14:47.236526 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c68973e0-41ea-46ca-a4ba-21137d5160d8 req-4c969d32-53b0-40dc-a9b6-98e6fc38ac83 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477476 Nov 08 16:14:47.945391 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:49.848475 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f98d5d0e-0436-4c9c-9e21-41a10268faa7 req-ec4b928c-5a39-44b3-90de-58ff4349d015 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:49.854193 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f98d5d0e-0436-4c9c-9e21-41a10268faa7 req-ec4b928c-5a39-44b3-90de-58ff4349d015 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=333fb179-0416-4534-95d0-4d9f3a9478f0 HTTP/1.1" status: 200 len: 945 time: 0.0733492 Nov 08 16:14:49.939426 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f98d5d0e-0436-4c9c-9e21-41a10268faa7 req-32aa2cc8-17c1-474e-b6fa-be34fb8ce843 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0632181 Nov 08 16:14:49.958835 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c59ef52-c47b-41a9-979a-bd00a32b0bbc req-59a92b70-d0ea-44ad-9f79-7c80d3a825cd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:49.960335 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0c59ef52-c47b-41a9-979a-bd00a32b0bbc req-59a92b70-d0ea-44ad-9f79-7c80d3a825cd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.1351058 Nov 08 16:14:50.025503 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0c59ef52-c47b-41a9-979a-bd00a32b0bbc req-885cdb15-fc64-4e4e-9634-90339fc106aa tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0591385 Nov 08 16:14:51.139769 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7728dab-f592-4fde-9157-208b0c0760d4 req-c84ad9ba-0d26-4989-869f-51e51ecb4633 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:51.150772 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a7728dab-f592-4fde-9157-208b0c0760d4 req-c84ad9ba-0d26-4989-869f-51e51ecb4633 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=333fb179-0416-4534-95d0-4d9f3a9478f0 HTTP/1.1" status: 200 len: 945 time: 0.1209037 Nov 08 16:14:51.319664 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a7728dab-f592-4fde-9157-208b0c0760d4 req-c5e05e2b-2d12-41ec-849b-a01569075a36 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1651411 Nov 08 16:14:51.328330 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e7c480a-3f62-420e-b9f3-9030da1a0766 req-bb515c7e-28d4-435c-a832-f82cb2b2ad27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:51.340518 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0e7c480a-3f62-420e-b9f3-9030da1a0766 req-bb515c7e-28d4-435c-a832-f82cb2b2ad27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.1585872 Nov 08 16:14:51.401943 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0e7c480a-3f62-420e-b9f3-9030da1a0766 req-04116eee-031e-43c1-8b52-41eda4506557 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0608964 Nov 08 16:14:56.030460 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6858aebc-210a-4040-93be-2065820b1313 req-8c72ec16-c2df-44bd-8264-d5f6ab6fc2f0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:56.032138 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6858aebc-210a-4040-93be-2065820b1313 req-8c72ec16-c2df-44bd-8264-d5f6ab6fc2f0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=333fb179-0416-4534-95d0-4d9f3a9478f0 HTTP/1.1" status: 200 len: 945 time: 0.0833886 Nov 08 16:14:56.045993 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8a6de5d-e98a-4930-b847-483ab04a5281 req-463390ea-4de7-4ede-982a-cf14097e2f54 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:56.047462 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d8a6de5d-e98a-4930-b847-483ab04a5281 req-463390ea-4de7-4ede-982a-cf14097e2f54 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0718787 Nov 08 16:14:56.118409 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6858aebc-210a-4040-93be-2065820b1313 req-3362e64c-c831-48a0-b3e0-80aa195000be tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0699823 Nov 08 16:14:56.130754 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d8a6de5d-e98a-4930-b847-483ab04a5281 req-dfe117f3-5767-4ca5-afee-2b17b3107cb7 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0761127 Nov 08 16:14:56.474062 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de3a47f1-b03d-409a-8f51-2681fba7448d req-aa67e445-da09-4f7d-ab10-4452a721c856 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:56.476237 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-de3a47f1-b03d-409a-8f51-2681fba7448d req-aa67e445-da09-4f7d-ab10-4452a721c856 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.25 "GET /v2.0/ports?device_id=333fb179-0416-4534-95d0-4d9f3a9478f0 HTTP/1.1" status: 200 len: 945 time: 0.0699801 Nov 08 16:14:56.581015 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-de3a47f1-b03d-409a-8f51-2681fba7448d req-3f3e10e9-7528-43d3-a8ca-13895df1d36f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Deleting port d14efac8-b33a-4eb0-b610-32a9bf41b972 {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:14:56.581825 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-de3a47f1-b03d-409a-8f51-2681fba7448d req-3f3e10e9-7528-43d3-a8ca-13895df1d36f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:56.682787 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-de3a47f1-b03d-409a-8f51-2681fba7448d req-3f3e10e9-7528-43d3-a8ca-13895df1d36f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] For port d14efac8-b33a-4eb0-b610-32a9bf41b972, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=d14efac8-b33a-4eb0-b610-32a9bf41b972,segment=NetworkSegment(fab7ad78-c438-48e7-8fdb-80ff50b8600c),segment_id=fab7ad78-c438-48e7-8fdb-80ff50b8600c)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:14:56.683083 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-de3a47f1-b03d-409a-8f51-2681fba7448d req-3f3e10e9-7528-43d3-a8ca-13895df1d36f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:56.697206 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-de3a47f1-b03d-409a-8f51-2681fba7448d req-3f3e10e9-7528-43d3-a8ca-13895df1d36f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling delete_port for d14efac8-b33a-4eb0-b610-32a9bf41b972 owned by compute:nova {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:14:56.840365 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-de3a47f1-b03d-409a-8f51-2681fba7448d req-3f3e10e9-7528-43d3-a8ca-13895df1d36f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:56.853506 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['4020a644-ef2e-4dd8-931a-cfccef4e7b15'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:14:56.900602 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f3e10e9-7528-43d3-a8ca-13895df1d36f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Pushing event deleted for resources: {'Port': ['ID=d14efac8-b33a-4eb0-b610-32a9bf41b972,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:14:56.932562 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3e10e9-7528-43d3-a8ca-13895df1d36f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:14:56.933039 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3e10e9-7528-43d3-a8ca-13895df1d36f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:14:56.933947 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3e10e9-7528-43d3-a8ca-13895df1d36f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:14:56.934289 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3e10e9-7528-43d3-a8ca-13895df1d36f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:14:56.934620 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3e10e9-7528-43d3-a8ca-13895df1d36f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:14:56.934954 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3e10e9-7528-43d3-a8ca-13895df1d36f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:14:56.935280 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3e10e9-7528-43d3-a8ca-13895df1d36f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:14:56.935602 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3e10e9-7528-43d3-a8ca-13895df1d36f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:14:56.935918 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3e10e9-7528-43d3-a8ca-13895df1d36f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:14:56.936233 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3e10e9-7528-43d3-a8ca-13895df1d36f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:14:56.936692 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3e10e9-7528-43d3-a8ca-13895df1d36f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:14:56.937012 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3e10e9-7528-43d3-a8ca-13895df1d36f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:14:56.956181 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-de3a47f1-b03d-409a-8f51-2681fba7448d req-3f3e10e9-7528-43d3-a8ca-13895df1d36f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] No DVR routers for this DVR port d14efac8-b33a-4eb0-b610-32a9bf41b972 on host hv-cinder-81618 {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:14:56.959945 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-de3a47f1-b03d-409a-8f51-2681fba7448d req-3f3e10e9-7528-43d3-a8ca-13895df1d36f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:14:56.964236 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-de3a47f1-b03d-409a-8f51-2681fba7448d req-3f3e10e9-7528-43d3-a8ca-13895df1d36f tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.25 "DELETE /v2.0/ports/d14efac8-b33a-4eb0-b610-32a9bf41b972 HTTP/1.1" status: 204 len: 173 time: 0.4800076 Nov 08 16:14:56.964718 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '333fb179-0416-4534-95d0-4d9f3a9478f0', 'name': 'network-vif-deleted', 'tag': 'd14efac8-b33a-4eb0-b610-32a9bf41b972'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:14:56.967420 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c9d88ff2-a456-4e42-8b2d-bebaada781a6" -d '{"events": [{"server_uuid": "333fb179-0416-4534-95d0-4d9f3a9478f0", "name": "network-vif-deleted", "tag": "d14efac8-b33a-4eb0-b610-32a9bf41b972"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:14:57.069525 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:14:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-acd0caa0-5be8-4aca-848e-8297ec02f99d x-openstack-request-id: req-acd0caa0-5be8-4aca-848e-8297ec02f99d {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:14:57.070215 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "333fb179-0416-4534-95d0-4d9f3a9478f0", "name": "network-vif-deleted", "tag": "d14efac8-b33a-4eb0-b610-32a9bf41b972", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:14:57.070215 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-acd0caa0-5be8-4aca-848e-8297ec02f99d {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:14:57.070497 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '333fb179-0416-4534-95d0-4d9f3a9478f0', 'name': 'network-vif-deleted', 'tag': 'd14efac8-b33a-4eb0-b610-32a9bf41b972', 'status': 'completed', 'code': 200} Nov 08 16:14:57.294189 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a5cc2ba-b912-4c41-9a19-b40e4a6d6c63 req-9deb3017-78a4-463b-9bc0-f152a09c1592 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:57.303532 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0a5cc2ba-b912-4c41-9a19-b40e4a6d6c63 req-9deb3017-78a4-463b-9bc0-f152a09c1592 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0755944 Nov 08 16:14:57.370857 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d92c91b1-52be-4fa3-9a00-3b7d732beff7 req-c5483972-3091-4f59-a83c-f304c7da5639 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=333fb179-0416-4534-95d0-4d9f3a9478f0 HTTP/1.1" status: 200 len: 210 time: 0.0577807 Nov 08 16:14:57.395483 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0a5cc2ba-b912-4c41-9a19-b40e4a6d6c63 req-03fad261-27da-4d09-a7ea-93a5223e436c tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0909455 Nov 08 16:14:58.355233 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device d14efac8-b33a-4eb0-b610-32a9bf41b972 no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:14:58.388245 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] No Port match for: d14efac8-b33a-4eb0-b610-32a9bf41b972 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:14:58.388592 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device d14efac8-b33a-4eb0-b610-32a9bf41b972 not bound to the agent host hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:14:59.837320 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e631ad0-f251-4b6d-acc8-cebdd2c54749 req-c2c6201b-a7c7-4cd6-aec2-b7b40b0eba21 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:14:59.838850 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5e631ad0-f251-4b6d-acc8-cebdd2c54749 req-c2c6201b-a7c7-4cd6-aec2-b7b40b0eba21 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 945 time: 0.0540624 Nov 08 16:14:59.889937 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5e631ad0-f251-4b6d-acc8-cebdd2c54749 req-a97254ef-d19c-4aaf-ba51-b815bb8432d3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434952 Nov 08 16:15:00.604900 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:15:01.015916 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb8a0460-d3c2-4073-b174-bdf831ecd5a3 req-9e811d52-3733-4ac8-b9fa-1a50762ca9b3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:01.018894 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-eb8a0460-d3c2-4073-b174-bdf831ecd5a3 req-9e811d52-3733-4ac8-b9fa-1a50762ca9b3 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 945 time: 0.0545411 Nov 08 16:15:01.072688 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-eb8a0460-d3c2-4073-b174-bdf831ecd5a3 req-76f897c0-13aa-4192-897c-9b5efc3b0491 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479288 Nov 08 16:15:02.037749 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0734529c-18e8-44c2-8b5a-1fce8ef29f7e req-0a028717-24ce-4f87-b7f1-0a337323c68c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:02.039226 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0734529c-18e8-44c2-8b5a-1fce8ef29f7e req-0a028717-24ce-4f87-b7f1-0a337323c68c tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.25 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 945 time: 0.0524256 Nov 08 16:15:02.149847 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-0734529c-18e8-44c2-8b5a-1fce8ef29f7e req-cf65cbe1-299b-49d0-a5e3-b08bd38db0ba tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Deleting port 4020a644-ef2e-4dd8-931a-cfccef4e7b15 {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:15:02.150192 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-0734529c-18e8-44c2-8b5a-1fce8ef29f7e req-cf65cbe1-299b-49d0-a5e3-b08bd38db0ba tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:02.270741 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4b5a699-3e48-4c83-98e4-2171ce574789 req-10278e77-a7aa-420c-b1df-cb33f3fe1724 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:02.277623 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b4b5a699-3e48-4c83-98e4-2171ce574789 req-10278e77-a7aa-420c-b1df-cb33f3fe1724 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/ports?device_id=dfa35d29-db7d-4fab-a001-7db0d508d70a HTTP/1.1" status: 200 len: 945 time: 0.0815313 Nov 08 16:15:02.311118 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-0734529c-18e8-44c2-8b5a-1fce8ef29f7e req-cf65cbe1-299b-49d0-a5e3-b08bd38db0ba tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] For port 4020a644-ef2e-4dd8-931a-cfccef4e7b15, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=4020a644-ef2e-4dd8-931a-cfccef4e7b15,segment=NetworkSegment(fab7ad78-c438-48e7-8fdb-80ff50b8600c),segment_id=fab7ad78-c438-48e7-8fdb-80ff50b8600c)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:15:02.311481 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-0734529c-18e8-44c2-8b5a-1fce8ef29f7e req-cf65cbe1-299b-49d0-a5e3-b08bd38db0ba tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:02.334693 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-0734529c-18e8-44c2-8b5a-1fce8ef29f7e req-cf65cbe1-299b-49d0-a5e3-b08bd38db0ba tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Calling delete_port for 4020a644-ef2e-4dd8-931a-cfccef4e7b15 owned by compute:nova {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:15:02.359563 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b4b5a699-3e48-4c83-98e4-2171ce574789 req-ffa85998-36ea-407c-a891-d5c034690dd0 tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.37 "GET /v2.0/security-groups?id=f4e825d4-82e2-4eb6-a4d3-6b2103528712&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0810781 Nov 08 16:15:02.546862 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6880778-dd11-4469-8639-9a10b35c5f3b req-840a91f0-a1ed-4c6f-b9d6-7622a2d8234a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:02.548330 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d6880778-dd11-4469-8639-9a10b35c5f3b req-840a91f0-a1ed-4c6f-b9d6-7622a2d8234a tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.1193376 Nov 08 16:15:02.559499 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9928bd6c-6a98-4417-9754-f9bde390ac36 req-6fba51f3-cd82-470c-a288-fd2cb95afc15 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:02.560884 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9928bd6c-6a98-4417-9754-f9bde390ac36 req-6fba51f3-cd82-470c-a288-fd2cb95afc15 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 945 time: 0.1305838 Nov 08 16:15:02.598494 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-0734529c-18e8-44c2-8b5a-1fce8ef29f7e req-cf65cbe1-299b-49d0-a5e3-b08bd38db0ba tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:02.652909 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf65cbe1-299b-49d0-a5e3-b08bd38db0ba tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Pushing event deleted for resources: {'Port': ['ID=4020a644-ef2e-4dd8-931a-cfccef4e7b15,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:02.700278 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d6880778-dd11-4469-8639-9a10b35c5f3b req-9e0142aa-2850-4bbd-ad0f-055334d44831 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1384568 Nov 08 16:15:02.715216 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9928bd6c-6a98-4417-9754-f9bde390ac36 req-651fbb56-41b9-49d3-9765-5e09014cc32b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1440244 Nov 08 16:15:02.716041 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-0734529c-18e8-44c2-8b5a-1fce8ef29f7e req-cf65cbe1-299b-49d0-a5e3-b08bd38db0ba tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] No DVR routers for this DVR port 4020a644-ef2e-4dd8-931a-cfccef4e7b15 on host hv-cinder-81618 {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:15:02.719243 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-0734529c-18e8-44c2-8b5a-1fce8ef29f7e req-cf65cbe1-299b-49d0-a5e3-b08bd38db0ba tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:02.723376 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0734529c-18e8-44c2-8b5a-1fce8ef29f7e req-cf65cbe1-299b-49d0-a5e3-b08bd38db0ba tempest-AttachVolumeNegativeTest-1381010144 tempest-AttachVolumeNegativeTest-1381010144-project] 10.222.0.25 "DELETE /v2.0/ports/4020a644-ef2e-4dd8-931a-cfccef4e7b15 HTTP/1.1" status: 204 len: 173 time: 0.6754673 Nov 08 16:15:02.723706 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dfa35d29-db7d-4fab-a001-7db0d508d70a', 'name': 'network-vif-deleted', 'tag': '4020a644-ef2e-4dd8-931a-cfccef4e7b15'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:15:02.726004 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7b9bf191-8ef1-4d69-8332-435555e1bfd4" -d '{"events": [{"server_uuid": "dfa35d29-db7d-4fab-a001-7db0d508d70a", "name": "network-vif-deleted", "tag": "4020a644-ef2e-4dd8-931a-cfccef4e7b15"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:15:02.859140 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:15:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-63179285-515f-4b21-bc82-24c08544aa59 x-openstack-request-id: req-63179285-515f-4b21-bc82-24c08544aa59 {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:15:02.859415 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dfa35d29-db7d-4fab-a001-7db0d508d70a", "name": "network-vif-deleted", "tag": "4020a644-ef2e-4dd8-931a-cfccef4e7b15", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:15:02.859665 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-63179285-515f-4b21-bc82-24c08544aa59 {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:15:02.860065 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dfa35d29-db7d-4fab-a001-7db0d508d70a', 'name': 'network-vif-deleted', 'tag': '4020a644-ef2e-4dd8-931a-cfccef4e7b15', 'status': 'completed', 'code': 200} Nov 08 16:15:03.225668 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 36648) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:03.275119 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_v2 [None req-9817f2e4-da4f-4acf-9ce8-19327daa8b18 admin admin] Deleting subnet d10afa0f-2bc3-4957-b3e4-84967992ae54 {{(pid=101244) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 16:15:03.279141 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9817f2e4-da4f-4acf-9ce8-19327daa8b18 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:03.315848 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9817f2e4-da4f-4acf-9ce8-19327daa8b18 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8047127'] for subnet, precommit_delete_associations {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:03.352529 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9817f2e4-da4f-4acf-9ce8-19327daa8b18 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-872226'] for subnet, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:03.403509 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9817f2e4-da4f-4acf-9ce8-19327daa8b18 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-872235', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4227786', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4279947'] for subnet, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:03.421170 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 36652) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:03.432361 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9817f2e4-da4f-4acf-9ce8-19327daa8b18 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for subnet, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:03.435584 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-9817f2e4-da4f-4acf-9ce8-19327daa8b18 admin admin] 10.222.0.37 "DELETE /v2.0/subnets/d10afa0f-2bc3-4957-b3e4-84967992ae54 HTTP/1.1" status: 204 len: 168 time: 0.2088268 Nov 08 16:15:03.436535 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9817f2e4-da4f-4acf-9ce8-19327daa8b18 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d10afa0f-2bc3-4957-b3e4-84967992ae54,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:03.438777 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 36654) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:03.468530 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_v2 [None req-cc3077f1-2c8f-4e49-89c3-d4a576dc1f14 admin admin] Deleting subnet cd23e532-b366-42a0-82e4-ec7326cf3b48 {{(pid=101245) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 16:15:03.472222 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-cc3077f1-2c8f-4e49-89c3-d4a576dc1f14 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:03.506180 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-cc3077f1-2c8f-4e49-89c3-d4a576dc1f14 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5113603'] for subnet, precommit_delete_associations {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:03.508962 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f82f4931-bfbd-4249-93d1-cdbd32598ea2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1007047'] for network, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:03.543444 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-cc3077f1-2c8f-4e49-89c3-d4a576dc1f14 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-872226'] for subnet, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:03.583924 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f82f4931-bfbd-4249-93d1-cdbd32598ea2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-869719', 'neutron.services.segments.db._delete_segments_for_network-8792877333297'] for network, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:03.596609 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-cc3077f1-2c8f-4e49-89c3-d4a576dc1f14 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-872235', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7464090', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6098572'] for subnet, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:03.610404 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-f82f4931-bfbd-4249-93d1-cdbd32598ea2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e']}} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:15:03.619624 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-f82f4931-bfbd-4249-93d1-cdbd32598ea2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4d73fdfb-694f-4679-be5c-5e9ca8483c31') {'for_net_delete': True} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:15:03.619917 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-f82f4931-bfbd-4249-93d1-cdbd32598ea2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4d73fdfb-694f-4679-be5c-5e9ca8483c31') {} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:15:03.624794 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc3077f1-2c8f-4e49-89c3-d4a576dc1f14 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=cd23e532-b366-42a0-82e4-ec7326cf3b48,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:03.628893 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-cc3077f1-2c8f-4e49-89c3-d4a576dc1f14 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:03.629662 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f82f4931-bfbd-4249-93d1-cdbd32598ea2 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792877333818', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8047118'] for segment, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:03.632070 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-cc3077f1-2c8f-4e49-89c3-d4a576dc1f14 admin admin] 10.222.0.37 "DELETE /v2.0/subnets/cd23e532-b366-42a0-82e4-ec7326cf3b48 HTTP/1.1" status: 204 len: 168 time: 0.2098749 Nov 08 16:15:03.634757 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 36656) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:03.646513 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f82f4931-bfbd-4249-93d1-cdbd32598ea2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:03.652572 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f82f4931-bfbd-4249-93d1-cdbd32598ea2 admin admin] Releasing vlan 189 on physical network physnet1 to pool {{(pid=101244) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 16:15:03.653049 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f82f4931-bfbd-4249-93d1-cdbd32598ea2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4227628'] for segment, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: Traceback (most recent call last): Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: timer() Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: cb(*args, **kw) Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: return func(*args, **kwargs) Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: self._notify() Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: self.callback(batched_events) Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: event.method(event) Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: return f(self, *a, **k) Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: return self._get(url).json() Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: return self.request(url, 'GET', **kwargs) Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 16:15:03.654671 dv-cinder-816187-2-iscsi neutron-server[101244]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 16:15:03.700388 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-72191998-2f06-415e-9f15-5531d1d06711 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1007047'] for network, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:03.707513 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f82f4931-bfbd-4249-93d1-cdbd32598ea2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-868772', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-2032313'] for network, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:03.711931 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f82f4931-bfbd-4249-93d1-cdbd32598ea2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:03.715301 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-f82f4931-bfbd-4249-93d1-cdbd32598ea2 admin admin] 10.222.0.37 "DELETE /v2.0/networks/e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e HTTP/1.1" status: 204 len: 168 time: 0.2754831 Nov 08 16:15:03.729135 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f82f4931-bfbd-4249-93d1-cdbd32598ea2 admin admin] Pushing event deleted for resources: {'Network': ['ID=e02a54af-8c5c-4f2d-a66c-5ec9f8e4de5e,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:03.791918 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-72191998-2f06-415e-9f15-5531d1d06711 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-869719', 'neutron.services.segments.db._delete_segments_for_network-8792877333297'] for network, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:03.815155 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.services.segments.db [None req-72191998-2f06-415e-9f15-5531d1d06711 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f70ee550-62a6-48db-bca5-a0b964bbcce9']}} {{(pid=101245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:15:03.825550 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.services.segments.db [None req-72191998-2f06-415e-9f15-5531d1d06711 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fab7ad78-c438-48e7-8fdb-80ff50b8600c') {'for_net_delete': True} {{(pid=101245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:15:03.826109 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.services.segments.db [None req-72191998-2f06-415e-9f15-5531d1d06711 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fab7ad78-c438-48e7-8fdb-80ff50b8600c') {} {{(pid=101245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:15:03.840632 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-72191998-2f06-415e-9f15-5531d1d06711 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792877333818', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5113626'] for segment, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:03.855022 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-72191998-2f06-415e-9f15-5531d1d06711 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:03.862849 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-72191998-2f06-415e-9f15-5531d1d06711 admin admin] Releasing vlan 173 on physical network physnet1 to pool {{(pid=101245) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 16:15:03.864176 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-72191998-2f06-415e-9f15-5531d1d06711 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7464060'] for segment, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: Traceback (most recent call last): Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: timer() Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: cb(*args, **kw) Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: return func(*args, **kwargs) Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: self._notify() Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: self.callback(batched_events) Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: event.method(event) Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: return f(self, *a, **k) Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: return self._get(url).json() Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: return self.request(url, 'GET', **kwargs) Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 16:15:03.867167 dv-cinder-816187-2-iscsi neutron-server[101245]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 16:15:03.872849 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c6ff9e2-9680-4303-9a7c-9c3186b58175 req-8a208b61-1fb4-4ef7-a036-4e7d80f765ac tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:03.874372 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3c6ff9e2-9680-4303-9a7c-9c3186b58175 req-8a208b61-1fb4-4ef7-a036-4e7d80f765ac tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0928528 Nov 08 16:15:03.888625 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-976d417b-5fc2-40bd-b1f3-a4fde01b98b8 req-62605f68-bb2c-4193-ad70-c84c6f5294c6 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:03.890128 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-976d417b-5fc2-40bd-b1f3-a4fde01b98b8 req-62605f68-bb2c-4193-ad70-c84c6f5294c6 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 945 time: 0.0828168 Nov 08 16:15:03.927661 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-72191998-2f06-415e-9f15-5531d1d06711 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-868772', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-2032313'] for network, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:03.942791 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-72191998-2f06-415e-9f15-5531d1d06711 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:03.946303 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-72191998-2f06-415e-9f15-5531d1d06711 admin admin] 10.222.0.37 "DELETE /v2.0/networks/f70ee550-62a6-48db-bca5-a0b964bbcce9 HTTP/1.1" status: 204 len: 168 time: 0.3104708 Nov 08 16:15:03.960305 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72191998-2f06-415e-9f15-5531d1d06711 admin admin] Pushing event deleted for resources: {'Network': ['ID=f70ee550-62a6-48db-bca5-a0b964bbcce9,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:03.968971 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3c6ff9e2-9680-4303-9a7c-9c3186b58175 req-67d2b3fe-776a-47a5-98aa-f777b996a50d tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0735428 Nov 08 16:15:03.987636 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 36670) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:03.998034 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-976d417b-5fc2-40bd-b1f3-a4fde01b98b8 req-b8befd33-197f-4526-808d-948f51c5052b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1007020 Nov 08 16:15:04.036844 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-1237a9a6-7bca-404a-b5e3-4da886c4ff50 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=9580ccbb790e4dff94da99ac8b1c98d5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0479488 Nov 08 16:15:04.039491 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 36672) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:04.089980 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-056a6656-20f0-4559-84c7-d605fa46c61c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:04.097185 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 36674) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:04.118751 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-056a6656-20f0-4559-84c7-d605fa46c61c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:04.136236 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-b80454da-d790-4baa-8340-c32e83ab4767 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=549e9715f7424ff5b3b252f354adafe9&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0378778 Nov 08 16:15:04.138754 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 36676) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:04.169962 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-056a6656-20f0-4559-84c7-d605fa46c61c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:04.172490 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-056a6656-20f0-4559-84c7-d605fa46c61c admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:04.173654 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-056a6656-20f0-4559-84c7-d605fa46c61c admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/7980e368-4ba2-4f63-995b-685d9baec7a2 HTTP/1.1" status: 204 len: 168 time: 0.1330824 Nov 08 16:15:04.181523 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-056a6656-20f0-4559-84c7-d605fa46c61c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7980e368-4ba2-4f63-995b-685d9baec7a2,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:04.186411 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5fcb6b16-f192-4eaa-a610-c3aa80a622d4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:04.213586 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5fcb6b16-f192-4eaa-a610-c3aa80a622d4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:04.261561 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5fcb6b16-f192-4eaa-a610-c3aa80a622d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:04.264288 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5fcb6b16-f192-4eaa-a610-c3aa80a622d4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:04.265399 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-5fcb6b16-f192-4eaa-a610-c3aa80a622d4 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/f4e825d4-82e2-4eb6-a4d3-6b2103528712 HTTP/1.1" status: 204 len: 168 time: 0.1256857 Nov 08 16:15:04.274655 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fcb6b16-f192-4eaa-a610-c3aa80a622d4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f4e825d4-82e2-4eb6-a4d3-6b2103528712,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:04.403128 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 4020a644-ef2e-4dd8-931a-cfccef4e7b15 no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:15:04.423135 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] No Port match for: 4020a644-ef2e-4dd8-931a-cfccef4e7b15 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:15:04.423753 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 4020a644-ef2e-4dd8-931a-cfccef4e7b15 not bound to the agent host hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:15:04.742508 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3a8bf01-8cca-42d9-adfd-a5096fddbdaa req-7a25050f-443a-4f88-abb8-f75da0292c50 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:04.744106 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b3a8bf01-8cca-42d9-adfd-a5096fddbdaa req-7a25050f-443a-4f88-abb8-f75da0292c50 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.25 "GET /v2.0/ports?device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 945 time: 0.0478716 Nov 08 16:15:04.847088 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-b3a8bf01-8cca-42d9-adfd-a5096fddbdaa req-fa7f5845-5b2b-40af-82cf-c58b0ae17d70 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Deleting port 69152346-0cf4-4b0a-9db9-f1bddb32dc4b {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:15:04.847421 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-b3a8bf01-8cca-42d9-adfd-a5096fddbdaa req-fa7f5845-5b2b-40af-82cf-c58b0ae17d70 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:04.943618 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-b3a8bf01-8cca-42d9-adfd-a5096fddbdaa req-fa7f5845-5b2b-40af-82cf-c58b0ae17d70 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] For port 69152346-0cf4-4b0a-9db9-f1bddb32dc4b, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=69152346-0cf4-4b0a-9db9-f1bddb32dc4b,segment=NetworkSegment(d89c6b3f-ecc6-4296-92e8-9f4a30c70af3),segment_id=d89c6b3f-ecc6-4296-92e8-9f4a30c70af3)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:15:04.943984 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-b3a8bf01-8cca-42d9-adfd-a5096fddbdaa req-fa7f5845-5b2b-40af-82cf-c58b0ae17d70 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:04.957772 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-b3a8bf01-8cca-42d9-adfd-a5096fddbdaa req-fa7f5845-5b2b-40af-82cf-c58b0ae17d70 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling delete_port for 69152346-0cf4-4b0a-9db9-f1bddb32dc4b owned by compute:nova {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:15:05.089522 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 36730) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:05.136664 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-118fbc3a-e28d-46c6-aaf5-3989a9727153 req-3693b53c-fcbf-4c05-a35f-40459321aec9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:05.138197 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-118fbc3a-e28d-46c6-aaf5-3989a9727153 req-3693b53c-fcbf-4c05-a35f-40459321aec9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0940182 Nov 08 16:15:05.195757 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-f1065e1b-3389-4dc9-9fa7-2f44eb551607 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-503589651-network', 'tenant_id': '40e7d1c11e0249218792136dc473db36'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:15:05.209246 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-791df445-a76a-4304-9336-2a1280a5ad8a req-bee6f257-3602-405f-8e12-f01bc3180d12 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:05.211080 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-791df445-a76a-4304-9336-2a1280a5ad8a req-bee6f257-3602-405f-8e12-f01bc3180d12 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=e41a90ba-f4f1-472e-9883-150d31bcc777 HTTP/1.1" status: 200 len: 945 time: 0.1119177 Nov 08 16:15:05.221861 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f1065e1b-3389-4dc9-9fa7-2f44eb551607 admin admin] Made reservation on behalf of 40e7d1c11e0249218792136dc473db36 for: {'network': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:15:05.224934 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f1065e1b-3389-4dc9-9fa7-2f44eb551607 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for network, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:05.234126 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f1065e1b-3389-4dc9-9fa7-2f44eb551607 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:05.259752 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-b3a8bf01-8cca-42d9-adfd-a5096fddbdaa req-fa7f5845-5b2b-40af-82cf-c58b0ae17d70 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:05.267567 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-118fbc3a-e28d-46c6-aaf5-3989a9727153 req-5cb92f0b-f35e-4406-a2be-3f329c19d9c3 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1150718 Nov 08 16:15:05.279169 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['69152346-0cf4-4b0a-9db9-f1bddb32dc4b'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:15:05.304222 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa7f5845-5b2b-40af-82cf-c58b0ae17d70 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Pushing event deleted for resources: {'Port': ['ID=69152346-0cf4-4b0a-9db9-f1bddb32dc4b,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:05.378443 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f1065e1b-3389-4dc9-9fa7-2f44eb551607 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:05.382462 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-791df445-a76a-4304-9336-2a1280a5ad8a req-6c63a88c-d7e1-4e96-8338-6ce47e9fa3e2 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1589165 Nov 08 16:15:05.394775 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f1065e1b-3389-4dc9-9fa7-2f44eb551607 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:05.396755 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-b3a8bf01-8cca-42d9-adfd-a5096fddbdaa req-fa7f5845-5b2b-40af-82cf-c58b0ae17d70 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] No DVR routers for this DVR port 69152346-0cf4-4b0a-9db9-f1bddb32dc4b on host hv-cinder-81618 {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:15:05.399616 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-b3a8bf01-8cca-42d9-adfd-a5096fddbdaa req-fa7f5845-5b2b-40af-82cf-c58b0ae17d70 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:05.403809 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b3a8bf01-8cca-42d9-adfd-a5096fddbdaa req-fa7f5845-5b2b-40af-82cf-c58b0ae17d70 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.25 "DELETE /v2.0/ports/69152346-0cf4-4b0a-9db9-f1bddb32dc4b HTTP/1.1" status: 204 len: 173 time: 0.6515796 Nov 08 16:15:05.404443 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e41a90ba-f4f1-472e-9883-150d31bcc777', 'name': 'network-vif-deleted', 'tag': '69152346-0cf4-4b0a-9db9-f1bddb32dc4b'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:15:05.407484 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-32c88ba8-5e3c-4157-a51c-9961fa0185a6" -d '{"events": [{"server_uuid": "e41a90ba-f4f1-472e-9883-150d31bcc777", "name": "network-vif-deleted", "tag": "69152346-0cf4-4b0a-9db9-f1bddb32dc4b"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:15:05.431390 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f1065e1b-3389-4dc9-9fa7-2f44eb551607 admin admin] vlan segment allocate from pool success with {'vlan_id': 178, 'physical_network': 'physnet1'} {{(pid=101245) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 16:15:05.444470 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1065e1b-3389-4dc9-9fa7-2f44eb551607 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=63f66ede-db99-4404-9302-782130c2887e,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:05.450968 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f1065e1b-3389-4dc9-9fa7-2f44eb551607 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:05.451514 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.db.segments_db [None req-f1065e1b-3389-4dc9-9fa7-2f44eb551607 admin admin] Added segment 28bf57e5-b5d0-4f66-9d87-5937265cf212 of type vlan for network 7aeaf2f9-16af-495c-948d-c7e03b9ab58c Nov 08 16:15:05.503115 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:15:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2e510524-5be3-4d0b-af37-9beff9af38c2 x-openstack-request-id: req-2e510524-5be3-4d0b-af37-9beff9af38c2 {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:15:05.503578 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e41a90ba-f4f1-472e-9883-150d31bcc777", "name": "network-vif-deleted", "tag": "69152346-0cf4-4b0a-9db9-f1bddb32dc4b", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:15:05.503995 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-2e510524-5be3-4d0b-af37-9beff9af38c2 {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:15:05.505110 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e41a90ba-f4f1-472e-9883-150d31bcc777', 'name': 'network-vif-deleted', 'tag': '69152346-0cf4-4b0a-9db9-f1bddb32dc4b', 'status': 'completed', 'code': 200} Nov 08 16:15:05.507682 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f1065e1b-3389-4dc9-9fa7-2f44eb551607 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792876766172'] for network, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:05.536955 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f1065e1b-3389-4dc9-9fa7-2f44eb551607 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for network, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:05.538087 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1065e1b-3389-4dc9-9fa7-2f44eb551607 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:05.538691 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f1065e1b-3389-4dc9-9fa7-2f44eb551607 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:05.605037 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-f1065e1b-3389-4dc9-9fa7-2f44eb551607 admin admin] 10.222.0.37 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 0.5142350 Nov 08 16:15:05.605775 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 36772) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:05.608297 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1065e1b-3389-4dc9-9fa7-2f44eb551607 admin admin] Pushing event updated for resources: {'Network': ['ID=7aeaf2f9-16af-495c-948d-c7e03b9ab58c,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:05.613812 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-7b3971e8-6659-4585-8e7a-8767f8a3f5b6 admin admin] Request body: {'subnet': {'network_id': '7aeaf2f9-16af-495c-948d-c7e03b9ab58c', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-503589651-subnet', 'tenant_id': '40e7d1c11e0249218792136dc473db36', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:15:05.619619 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Network 7aeaf2f9-16af-495c-948d-c7e03b9ab58c details requested by agent ovs-agent-dv-cinder-816187-2-iscsi with host dv-cinder-816187-2-iscsi {{(pid=101246) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 16:15:05.636183 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7b3971e8-6659-4585-8e7a-8767f8a3f5b6 admin admin] Made reservation on behalf of 40e7d1c11e0249218792136dc473db36 for: {'subnet': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:15:05.638644 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7b3971e8-6659-4585-8e7a-8767f8a3f5b6 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4280170'] for subnet, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:05.977340 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-255afce8-9fd4-483d-b872-4050475fd848 req-39d03df6-cc24-4675-889f-2fc62f99b99f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:05.978847 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-255afce8-9fd4-483d-b872-4050475fd848 req-39d03df6-cc24-4675-889f-2fc62f99b99f tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.25 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.0795879 Nov 08 16:15:06.156651 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7b3971e8-6659-4585-8e7a-8767f8a3f5b6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-4227723', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4279952'] for subnet, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:06.195438 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-255afce8-9fd4-483d-b872-4050475fd848 req-e2576cb5-9869-4b52-9705-a831ed489bf9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Deleting port 3e7ad14a-6975-4075-ac69-3a504ad24341 {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:15:06.195744 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-255afce8-9fd4-483d-b872-4050475fd848 req-e2576cb5-9869-4b52-9705-a831ed489bf9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:06.252653 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b3971e8-6659-4585-8e7a-8767f8a3f5b6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=601acad8-6e32-4ac3-8cdb-1e8110b0525e,revision_number=0']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:06.305345 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b3971e8-6659-4585-8e7a-8767f8a3f5b6 admin admin] Checking segment: {'id': '28bf57e5-b5d0-4f66-9d87-5937265cf212', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 178, 'network_id': '7aeaf2f9-16af-495c-948d-c7e03b9ab58c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:15:06.306015 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b3971e8-6659-4585-8e7a-8767f8a3f5b6 admin admin] Network hostable DHCP agents. Network: 7aeaf2f9-16af-495c-948d-c7e03b9ab58c, hostable agents: ['a7e1e7ee-1ce2-474e-9688-58f0884991a4'], hosted agents: [] {{(pid=101244) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 16:15:06.330344 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-255afce8-9fd4-483d-b872-4050475fd848 req-e2576cb5-9869-4b52-9705-a831ed489bf9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] For port 3e7ad14a-6975-4075-ac69-3a504ad24341, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=3e7ad14a-6975-4075-ac69-3a504ad24341,segment=NetworkSegment(e14404ea-b710-490a-b578-a605dfc73350),segment_id=e14404ea-b710-490a-b578-a605dfc73350)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:15:06.331212 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-255afce8-9fd4-483d-b872-4050475fd848 req-e2576cb5-9869-4b52-9705-a831ed489bf9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:06.347688 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-255afce8-9fd4-483d-b872-4050475fd848 req-e2576cb5-9869-4b52-9705-a831ed489bf9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling delete_port for 3e7ad14a-6975-4075-ac69-3a504ad24341 owned by compute:nova {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:15:06.353326 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b3971e8-6659-4585-8e7a-8767f8a3f5b6 admin admin] Network 7aeaf2f9-16af-495c-948d-c7e03b9ab58c is scheduled to be hosted by DHCP agent a7e1e7ee-1ce2-474e-9688-58f0884991a4 with binding_index 1 {{(pid=101244) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 16:15:06.419849 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-7b3971e8-6659-4585-8e7a-8767f8a3f5b6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816187-2-iscsi, 7aeaf2f9-16af-495c-948d-c7e03b9ab58c) {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:15:06.428778 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b3971e8-6659-4585-8e7a-8767f8a3f5b6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:06.429365 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7b3971e8-6659-4585-8e7a-8767f8a3f5b6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for subnet, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:06.429953 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f727b82-fe52-4dac-bd5d-ccc8343674f4 None None] Network 7aeaf2f9-16af-495c-948d-c7e03b9ab58c requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:15:06.474086 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-7b3971e8-6659-4585-8e7a-8767f8a3f5b6 admin admin] 10.222.0.37 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 0.8670034 Nov 08 16:15:06.494458 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79e9d87e-4e37-4cf7-b034-500dee5d25de req-b62ac288-236e-41fc-98c2-46f496dea9f2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:06.495970 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-79e9d87e-4e37-4cf7-b034-500dee5d25de req-b62ac288-236e-41fc-98c2-46f496dea9f2 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 946 time: 0.1372156 Nov 08 16:15:06.600922 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-79e9d87e-4e37-4cf7-b034-500dee5d25de req-327981dc-776a-4a42-962c-3d7f980ee041 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0879827 Nov 08 16:15:06.635047 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-255afce8-9fd4-483d-b872-4050475fd848 req-e2576cb5-9869-4b52-9705-a831ed489bf9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:06.658198 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['17db566c-bf28-4091-b7f6-4ffa5f80c982'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:15:06.667527 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2576cb5-9869-4b52-9705-a831ed489bf9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Pushing event deleted for resources: {'Port': ['ID=3e7ad14a-6975-4075-ac69-3a504ad24341,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:06.739108 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-255afce8-9fd4-483d-b872-4050475fd848 req-e2576cb5-9869-4b52-9705-a831ed489bf9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] No DVR routers for this DVR port 3e7ad14a-6975-4075-ac69-3a504ad24341 on host hv-cinder-81618 {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:15:06.741846 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-255afce8-9fd4-483d-b872-4050475fd848 req-e2576cb5-9869-4b52-9705-a831ed489bf9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:06.745167 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-255afce8-9fd4-483d-b872-4050475fd848 req-e2576cb5-9869-4b52-9705-a831ed489bf9 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.25 "DELETE /v2.0/ports/3e7ad14a-6975-4075-ac69-3a504ad24341 HTTP/1.1" status: 204 len: 173 time: 0.7555516 Nov 08 16:15:06.758652 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28a24ffa-440b-4df5-ad36-e38c44d44bb5 None None] Network 7aeaf2f9-16af-495c-948d-c7e03b9ab58c requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:15:07.075277 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 36820) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:07.080231 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-576a36d7-ae1b-4ac6-8313-a75404f39eac admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1819057502-network', 'tenant_id': '830811a74e8e4274a094ae74c518633d'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:15:07.100869 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-576a36d7-ae1b-4ac6-8313-a75404f39eac admin admin] Made reservation on behalf of 830811a74e8e4274a094ae74c518633d for: {'network': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:15:07.103257 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-576a36d7-ae1b-4ac6-8313-a75404f39eac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for network, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:07.112233 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-576a36d7-ae1b-4ac6-8313-a75404f39eac admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:07.186818 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-576a36d7-ae1b-4ac6-8313-a75404f39eac admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:07.190415 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-576a36d7-ae1b-4ac6-8313-a75404f39eac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:07.213640 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-576a36d7-ae1b-4ac6-8313-a75404f39eac admin admin] vlan segment allocate from pool success with {'vlan_id': 154, 'physical_network': 'physnet1'} {{(pid=101244) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 16:15:07.223436 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-576a36d7-ae1b-4ac6-8313-a75404f39eac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2357d78d-0bb6-444d-a933-41e9f3b9a448,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:07.228296 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-576a36d7-ae1b-4ac6-8313-a75404f39eac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:07.228632 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.db.segments_db [None req-576a36d7-ae1b-4ac6-8313-a75404f39eac admin admin] Added segment 981d87b4-556c-41cf-8c50-53c651e53f7c of type vlan for network 6de0417d-dd5c-4ab0-87fa-ed3bdac3eecd Nov 08 16:15:07.270050 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-576a36d7-ae1b-4ac6-8313-a75404f39eac admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792876766172'] for network, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:07.294384 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-576a36d7-ae1b-4ac6-8313-a75404f39eac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for network, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:07.295314 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-576a36d7-ae1b-4ac6-8313-a75404f39eac admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:07.295918 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-576a36d7-ae1b-4ac6-8313-a75404f39eac admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:07.354730 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-576a36d7-ae1b-4ac6-8313-a75404f39eac admin admin] 10.222.0.37 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.2783389 Nov 08 16:15:07.357365 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 36822) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:07.362513 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-7bccc855-d0bd-46be-ab04-e118ea3ff3d8 admin admin] Request body: {'subnet': {'network_id': '6de0417d-dd5c-4ab0-87fa-ed3bdac3eecd', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1819057502-subnet', 'tenant_id': '830811a74e8e4274a094ae74c518633d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:15:07.370304 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-576a36d7-ae1b-4ac6-8313-a75404f39eac admin admin] Pushing event updated for resources: {'Network': ['ID=6de0417d-dd5c-4ab0-87fa-ed3bdac3eecd,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:07.381062 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Network 6de0417d-dd5c-4ab0-87fa-ed3bdac3eecd details requested by agent ovs-agent-dv-cinder-816187-2-iscsi with host dv-cinder-816187-2-iscsi {{(pid=101246) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 16:15:07.386433 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7bccc855-d0bd-46be-ab04-e118ea3ff3d8 admin admin] Made reservation on behalf of 830811a74e8e4274a094ae74c518633d for: {'subnet': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:15:07.388713 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7bccc855-d0bd-46be-ab04-e118ea3ff3d8 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4280170'] for subnet, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:07.505818 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a3a953f3-d586-4495-b2d1-3c6e6cd89a52', 'name': 'network-vif-deleted', 'tag': '3e7ad14a-6975-4075-ac69-3a504ad24341'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:15:07.507940 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dc8765e0-9c14-46f9-aa73-66f5ee0739cd" -d '{"events": [{"server_uuid": "a3a953f3-d586-4495-b2d1-3c6e6cd89a52", "name": "network-vif-deleted", "tag": "3e7ad14a-6975-4075-ac69-3a504ad24341"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:15:07.552144 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:15:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0b43c3b0-6d7d-45e9-adad-9ef2c4b3d938 x-openstack-request-id: req-0b43c3b0-6d7d-45e9-adad-9ef2c4b3d938 {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:15:07.552427 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a3a953f3-d586-4495-b2d1-3c6e6cd89a52", "name": "network-vif-deleted", "tag": "3e7ad14a-6975-4075-ac69-3a504ad24341", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:15:07.552667 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-0b43c3b0-6d7d-45e9-adad-9ef2c4b3d938 {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:15:07.553046 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a3a953f3-d586-4495-b2d1-3c6e6cd89a52', 'name': 'network-vif-deleted', 'tag': '3e7ad14a-6975-4075-ac69-3a504ad24341', 'status': 'completed', 'code': 200} Nov 08 16:15:07.568754 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7bccc855-d0bd-46be-ab04-e118ea3ff3d8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-4227723', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4279952'] for subnet, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:07.627422 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bccc855-d0bd-46be-ab04-e118ea3ff3d8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d3385f6a-da60-4c2a-a715-d850270c39fa,revision_number=0']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:07.637964 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bccc855-d0bd-46be-ab04-e118ea3ff3d8 admin admin] Checking segment: {'id': '981d87b4-556c-41cf-8c50-53c651e53f7c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 154, 'network_id': '6de0417d-dd5c-4ab0-87fa-ed3bdac3eecd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:15:07.638393 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7bccc855-d0bd-46be-ab04-e118ea3ff3d8 admin admin] Network hostable DHCP agents. Network: 6de0417d-dd5c-4ab0-87fa-ed3bdac3eecd, hostable agents: ['a7e1e7ee-1ce2-474e-9688-58f0884991a4'], hosted agents: [] {{(pid=101244) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 16:15:07.654864 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7bccc855-d0bd-46be-ab04-e118ea3ff3d8 admin admin] Network 6de0417d-dd5c-4ab0-87fa-ed3bdac3eecd is scheduled to be hosted by DHCP agent a7e1e7ee-1ce2-474e-9688-58f0884991a4 with binding_index 1 {{(pid=101244) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 16:15:07.664825 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-7bccc855-d0bd-46be-ab04-e118ea3ff3d8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816187-2-iscsi, 6de0417d-dd5c-4ab0-87fa-ed3bdac3eecd) {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:15:07.669380 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7bccc855-d0bd-46be-ab04-e118ea3ff3d8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:07.670384 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7bccc855-d0bd-46be-ab04-e118ea3ff3d8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for subnet, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:07.674345 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ef282988-a8e5-4cd0-818b-fe121811dcc3 None None] Network 6de0417d-dd5c-4ab0-87fa-ed3bdac3eecd requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:15:07.708269 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1bd7dbbe-02bf-4ff8-89b1-11e8bbdc1457 req-e6966ef8-58f3-4951-9dee-0e5948352b46 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 210 time: 0.0287054 Nov 08 16:15:07.711632 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-7bccc855-d0bd-46be-ab04-e118ea3ff3d8 admin admin] 10.222.0.37 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.3533242 Nov 08 16:15:07.816134 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e9d2677-0061-480a-ba77-452adcc51a33 None None] Network 6de0417d-dd5c-4ab0-87fa-ed3bdac3eecd requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:15:07.846534 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 36836) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:07.891521 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_v2 [None req-baec8317-9fb1-44f4-b6da-b274aae802fd admin admin] Deleting subnet 601acad8-6e32-4ac3-8cdb-1e8110b0525e {{(pid=101245) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 16:15:07.896191 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-baec8317-9fb1-44f4-b6da-b274aae802fd admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:07.934905 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-baec8317-9fb1-44f4-b6da-b274aae802fd admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5113603'] for subnet, precommit_delete_associations {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:07.976491 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-baec8317-9fb1-44f4-b6da-b274aae802fd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-872226'] for subnet, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:08.025798 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-baec8317-9fb1-44f4-b6da-b274aae802fd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-872235', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7464090', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6098572'] for subnet, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:08.052027 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baec8317-9fb1-44f4-b6da-b274aae802fd admin admin] Pushing event deleted for resources: {'Subnet': ['ID=601acad8-6e32-4ac3-8cdb-1e8110b0525e,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:08.053978 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-baec8317-9fb1-44f4-b6da-b274aae802fd admin admin] Publish callbacks [] for subnet, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:08.057110 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-baec8317-9fb1-44f4-b6da-b274aae802fd admin admin] 10.222.0.37 "DELETE /v2.0/subnets/601acad8-6e32-4ac3-8cdb-1e8110b0525e HTTP/1.1" status: 204 len: 168 time: 0.2095132 Nov 08 16:15:08.059596 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 36840) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:08.114833 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-4ce39722-71ad-4e06-bf1f-48be9ff4c1a8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:08.128554 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-27db57b8-16ad-42fe-8f54-3878b13ae99a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1007047'] for network, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:08.206362 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-27db57b8-16ad-42fe-8f54-3878b13ae99a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-869719', 'neutron.services.segments.db._delete_segments_for_network-8792877333297'] for network, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:08.225912 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.services.segments.db [None req-27db57b8-16ad-42fe-8f54-3878b13ae99a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7aeaf2f9-16af-495c-948d-c7e03b9ab58c']}} {{(pid=101245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:15:08.234718 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.services.segments.db [None req-27db57b8-16ad-42fe-8f54-3878b13ae99a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '28bf57e5-b5d0-4f66-9d87-5937265cf212') {'for_net_delete': True} {{(pid=101245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:15:08.235004 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.services.segments.db [None req-27db57b8-16ad-42fe-8f54-3878b13ae99a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '28bf57e5-b5d0-4f66-9d87-5937265cf212') {} {{(pid=101245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:15:08.243825 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-27db57b8-16ad-42fe-8f54-3878b13ae99a admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792877333818', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5113626'] for segment, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:08.256492 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-27db57b8-16ad-42fe-8f54-3878b13ae99a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:08.262480 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-27db57b8-16ad-42fe-8f54-3878b13ae99a admin admin] Releasing vlan 178 on physical network physnet1 to pool {{(pid=101245) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 16:15:08.262870 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-27db57b8-16ad-42fe-8f54-3878b13ae99a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7464060'] for segment, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: Traceback (most recent call last): Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: timer() Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: cb(*args, **kw) Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: return func(*args, **kwargs) Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: self._notify() Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: self.callback(batched_events) Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: event.method(event) Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: return f(self, *a, **k) Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: return self._get(url).json() Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: return self.request(url, 'GET', **kwargs) Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 16:15:08.264741 dv-cinder-816187-2-iscsi neutron-server[101245]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 16:15:08.318938 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-27db57b8-16ad-42fe-8f54-3878b13ae99a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-868772', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-2032313'] for network, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:08.323806 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-27db57b8-16ad-42fe-8f54-3878b13ae99a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:08.327007 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-27db57b8-16ad-42fe-8f54-3878b13ae99a admin admin] 10.222.0.37 "DELETE /v2.0/networks/7aeaf2f9-16af-495c-948d-c7e03b9ab58c HTTP/1.1" status: 204 len: 168 time: 0.2665129 Nov 08 16:15:08.329899 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 36842) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:08.340001 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27db57b8-16ad-42fe-8f54-3878b13ae99a admin admin] Pushing event deleted for resources: {'Network': ['ID=7aeaf2f9-16af-495c-948d-c7e03b9ab58c,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:08.373743 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_v2 [None req-03391787-6417-4f27-8c88-b130b5cc401c admin admin] Deleting subnet d3385f6a-da60-4c2a-a715-d850270c39fa {{(pid=101244) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 16:15:08.376988 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-03391787-6417-4f27-8c88-b130b5cc401c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:08.416040 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-03391787-6417-4f27-8c88-b130b5cc401c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8047127'] for subnet, precommit_delete_associations {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:08.453633 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-03391787-6417-4f27-8c88-b130b5cc401c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-872226'] for subnet, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:08.505771 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-03391787-6417-4f27-8c88-b130b5cc401c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-872235', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4227786', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4279947'] for subnet, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:08.530521 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03391787-6417-4f27-8c88-b130b5cc401c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d3385f6a-da60-4c2a-a715-d850270c39fa,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:08.536114 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-03391787-6417-4f27-8c88-b130b5cc401c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for subnet, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:08.539243 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-03391787-6417-4f27-8c88-b130b5cc401c admin admin] 10.222.0.37 "DELETE /v2.0/subnets/d3385f6a-da60-4c2a-a715-d850270c39fa HTTP/1.1" status: 204 len: 168 time: 0.2077098 Nov 08 16:15:08.541671 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 36846) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:08.609954 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-58fd90a1-cdfe-40c9-83ac-704f64184212 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1007047'] for network, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:08.683886 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-58fd90a1-cdfe-40c9-83ac-704f64184212 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-869719', 'neutron.services.segments.db._delete_segments_for_network-8792877333297'] for network, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:08.704056 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-58fd90a1-cdfe-40c9-83ac-704f64184212 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6de0417d-dd5c-4ab0-87fa-ed3bdac3eecd']}} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:15:08.714698 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-58fd90a1-cdfe-40c9-83ac-704f64184212 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '981d87b4-556c-41cf-8c50-53c651e53f7c') {'for_net_delete': True} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:15:08.714989 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-58fd90a1-cdfe-40c9-83ac-704f64184212 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '981d87b4-556c-41cf-8c50-53c651e53f7c') {} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:15:08.728523 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-58fd90a1-cdfe-40c9-83ac-704f64184212 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792877333818', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8047118'] for segment, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:08.741216 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-58fd90a1-cdfe-40c9-83ac-704f64184212 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:08.747065 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-58fd90a1-cdfe-40c9-83ac-704f64184212 admin admin] Releasing vlan 154 on physical network physnet1 to pool {{(pid=101244) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 16:15:08.747437 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-58fd90a1-cdfe-40c9-83ac-704f64184212 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4227628'] for segment, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: Traceback (most recent call last): Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: timer() Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: cb(*args, **kw) Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: return func(*args, **kwargs) Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: self._notify() Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: self.callback(batched_events) Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: event.method(event) Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: return f(self, *a, **k) Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: return self._get(url).json() Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: return self.request(url, 'GET', **kwargs) Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 16:15:08.748993 dv-cinder-816187-2-iscsi neutron-server[101244]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 16:15:08.801351 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-58fd90a1-cdfe-40c9-83ac-704f64184212 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-868772', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-2032313'] for network, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:08.806734 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-58fd90a1-cdfe-40c9-83ac-704f64184212 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:08.809824 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-58fd90a1-cdfe-40c9-83ac-704f64184212 admin admin] 10.222.0.37 "DELETE /v2.0/networks/6de0417d-dd5c-4ab0-87fa-ed3bdac3eecd HTTP/1.1" status: 204 len: 168 time: 0.2672081 Nov 08 16:15:08.821020 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58fd90a1-cdfe-40c9-83ac-704f64184212 admin admin] Pushing event deleted for resources: {'Network': ['ID=6de0417d-dd5c-4ab0-87fa-ed3bdac3eecd,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:08.979157 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 36856) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:09.000658 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 3e7ad14a-6975-4075-ac69-3a504ad24341 no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:15:09.019867 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] No Port match for: 3e7ad14a-6975-4075-ac69-3a504ad24341 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:15:09.020204 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 3e7ad14a-6975-4075-ac69-3a504ad24341 not bound to the agent host hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:15:09.020608 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 69152346-0cf4-4b0a-9db9-f1bddb32dc4b no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:15:09.021981 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-37ae15a7-a990-429d-b615-568ec9fa52aa admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=40e7d1c11e0249218792136dc473db36&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0415080 Nov 08 16:15:09.024489 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 36858) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:09.039078 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] No Port match for: 69152346-0cf4-4b0a-9db9-f1bddb32dc4b {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:15:09.039415 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 69152346-0cf4-4b0a-9db9-f1bddb32dc4b not bound to the agent host hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:15:09.072774 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f883e734-640e-4cd2-92aa-7e7866ed123c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:09.092724 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f883e734-640e-4cd2-92aa-7e7866ed123c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:09.137459 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f883e734-640e-4cd2-92aa-7e7866ed123c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:09.139957 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f883e734-640e-4cd2-92aa-7e7866ed123c admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:09.141081 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-f883e734-640e-4cd2-92aa-7e7866ed123c admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/63f66ede-db99-4404-9302-782130c2887e HTTP/1.1" status: 204 len: 168 time: 0.1157122 Nov 08 16:15:09.149583 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f883e734-640e-4cd2-92aa-7e7866ed123c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=63f66ede-db99-4404-9302-782130c2887e,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:09.450435 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 36864) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:09.488129 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-9388bd5c-1595-4c67-836f-bf97c6effc47 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=830811a74e8e4274a094ae74c518633d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0365872 Nov 08 16:15:09.490524 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 36866) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:09.538312 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-170de87a-6d64-4ea8-83ff-426191fd5a18 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:09.558544 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-170de87a-6d64-4ea8-83ff-426191fd5a18 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:09.606111 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-170de87a-6d64-4ea8-83ff-426191fd5a18 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:09.608640 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-170de87a-6d64-4ea8-83ff-426191fd5a18 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:09.609782 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-170de87a-6d64-4ea8-83ff-426191fd5a18 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/2357d78d-0bb6-444d-a933-41e9f3b9a448 HTTP/1.1" status: 204 len: 168 time: 0.1183364 Nov 08 16:15:09.617126 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-170de87a-6d64-4ea8-83ff-426191fd5a18 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2357d78d-0bb6-444d-a933-41e9f3b9a448,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:10.583177 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-12fa2ad6-6a5b-4e90-b675-fa2def398047 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:11.524428 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:11.787605 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-de689745-3c70-424c-bea9-38b9db7d9c69 req-8e846df8-fff9-4d7d-9d55-14816adf2368 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=a3a953f3-d586-4495-b2d1-3c6e6cd89a52 HTTP/1.1" status: 200 len: 210 time: 0.0319409 Nov 08 16:15:13.074221 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-226c1ddb-1e9d-4cec-9244-225aa6b9b203 req-4ed5935a-374b-4b07-8ea8-bd09eadcf024 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:13.075696 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-226c1ddb-1e9d-4cec-9244-225aa6b9b203 req-4ed5935a-374b-4b07-8ea8-bd09eadcf024 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0497153 Nov 08 16:15:13.122957 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-226c1ddb-1e9d-4cec-9244-225aa6b9b203 req-6a5bb652-d3f8-4916-938b-5627d65db966 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413289 Nov 08 16:15:13.254781 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:13.954068 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:14.256011 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5661e70d-1a06-471d-a066-bdd7cc570f49 req-da0d7bb0-5cca-4767-b4de-daa07be5c5bd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:14.257563 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5661e70d-1a06-471d-a066-bdd7cc570f49 req-da0d7bb0-5cca-4767-b4de-daa07be5c5bd tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0613430 Nov 08 16:15:14.307080 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5661e70d-1a06-471d-a066-bdd7cc570f49 req-c61fc6d9-c5e3-4632-af87-b0aa7678a2e4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434957 Nov 08 16:15:17.947230 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:19.226874 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f89a9ece-47b0-4bd5-92f6-63676dd2949c req-1201ee4a-8e93-4376-a6fd-4659d3302279 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:19.228307 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f89a9ece-47b0-4bd5-92f6-63676dd2949c req-1201ee4a-8e93-4376-a6fd-4659d3302279 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0493877 Nov 08 16:15:19.301236 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-945c8a48-ab66-4206-b9fb-ec43801c13ec req-848cf6dd-c6b8-444d-8b98-12fde88b6d6e service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0681298 Nov 08 16:15:19.305863 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f89a9ece-47b0-4bd5-92f6-63676dd2949c req-59b03a90-05d0-4b54-bf21-76e5c77ac3e0 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0716784 Nov 08 16:15:19.366745 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-945c8a48-ab66-4206-b9fb-ec43801c13ec req-846003b9-1b76-4c81-8247-7a37e53922ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:19.368231 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-945c8a48-ab66-4206-b9fb-ec43801c13ec req-846003b9-1b76-4c81-8247-7a37e53922ff service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=f6e779f0506643d08d984c2971d5a71c&device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 1098 time: 0.0445857 Nov 08 16:15:19.477035 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-945c8a48-ab66-4206-b9fb-ec43801c13ec req-92fca1dc-e671-4951-b673-ca25ad8a09c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:19.478621 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-945c8a48-ab66-4206-b9fb-ec43801c13ec req-92fca1dc-e671-4951-b673-ca25ad8a09c2 service neutron] 10.222.0.25 "GET /v2.0/networks?id=75fa9c3e-7bfe-490a-9118-221394c29646 HTTP/1.1" status: 200 len: 911 time: 0.0871122 Nov 08 16:15:19.551130 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-945c8a48-ab66-4206-b9fb-ec43801c13ec req-3dd23cb9-af86-4534-8eb9-db663394f3bd service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f4784d76-6af7-4b31-a9f3-ee25c9087b51 HTTP/1.1" status: 200 len: 1000 time: 0.0628860 Nov 08 16:15:19.602116 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-945c8a48-ab66-4206-b9fb-ec43801c13ec req-cab938d6-1d05-459c-a383-49b1c916bdbf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:19.603528 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-945c8a48-ab66-4206-b9fb-ec43801c13ec req-cab938d6-1d05-459c-a383-49b1c916bdbf service neutron] 10.222.0.25 "GET /v2.0/subnets?id=8b248e51-4c70-4980-9452-c6b625bf96dd HTTP/1.1" status: 200 len: 849 time: 0.0435112 Nov 08 16:15:19.649995 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-945c8a48-ab66-4206-b9fb-ec43801c13ec req-8971acf2-b405-4a39-893b-3b32862f7bfb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:19.651467 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-945c8a48-ab66-4206-b9fb-ec43801c13ec req-8971acf2-b405-4a39-893b-3b32862f7bfb service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=75fa9c3e-7bfe-490a-9118-221394c29646&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0396512 Nov 08 16:15:19.746138 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-945c8a48-ab66-4206-b9fb-ec43801c13ec req-02e4f629-557d-4cf6-a157-428627e13c2d service neutron] 10.222.0.25 "GET /v2.0/networks/75fa9c3e-7bfe-490a-9118-221394c29646?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0830793 Nov 08 16:15:19.836458 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-945c8a48-ab66-4206-b9fb-ec43801c13ec req-2c5cd75c-c7db-439a-9284-16404004ff04 service neutron] 10.222.0.25 "GET /v2.0/networks/75fa9c3e-7bfe-490a-9118-221394c29646?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817671 Nov 08 16:15:24.645204 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c68845e-ded9-4ff3-91de-2098bc27607a req-01281d34-304d-40a6-889a-fa08051a7df3 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:24.646688 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9c68845e-ded9-4ff3-91de-2098bc27607a req-01281d34-304d-40a6-889a-fa08051a7df3 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0491560 Nov 08 16:15:24.693439 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9c68845e-ded9-4ff3-91de-2098bc27607a req-5040b61f-66d5-4566-86c1-2c8c444dd92e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410647 Nov 08 16:15:25.861932 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3be3208-5349-41ab-a241-2e3d72eff06a req-26357eab-d9c7-41fd-95f5-402e0e60b6cb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:25.863422 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e3be3208-5349-41ab-a241-2e3d72eff06a req-26357eab-d9c7-41fd-95f5-402e0e60b6cb tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0792742 Nov 08 16:15:25.871921 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-ea5a82f2-5dc9-4319-8d32-f4e892770321 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:25.873326 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-ea5a82f2-5dc9-4319-8d32-f4e892770321 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/networks?id=63da175a-847c-472d-b285-2df5d0b798a0 HTTP/1.1" status: 200 len: 813 time: 0.1531196 Nov 08 16:15:25.911123 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-78f46a1d-7afd-45a9-8d9b-10ec43beac2a tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/quotas/e5e827086bb348d190546b9a0c0ba087 HTTP/1.1" status: 200 len: 375 time: 0.0234487 Nov 08 16:15:25.936075 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e3be3208-5349-41ab-a241-2e3d72eff06a req-209d65ed-ff4a-4955-9fd4-817ce29ca6dc tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0617919 Nov 08 16:15:25.950543 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-eda59cb3-5d95-4a97-aa9b-d8bc1dfa0548 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?tenant_id=e5e827086bb348d190546b9a0c0ba087&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0339594 Nov 08 16:15:26.036672 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-b0fd4e59-92d9-410b-b569-bfe752265d9b service neutron] 10.222.0.37 "GET /v2.0/networks/63da175a-847c-472d-b285-2df5d0b798a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0788562 Nov 08 16:15:26.126815 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-9b1fdc03-0e2f-43d6-8d66-304647358c0f service neutron] 10.222.0.37 "GET /v2.0/networks/63da175a-847c-472d-b285-2df5d0b798a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0840542 Nov 08 16:15:26.280668 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8fb89491-7bf4-45e0-ab32-05e7b4e77b9d req-3c985a35-5eb1-4f90-a3c7-066c21b5d435 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=116d828b-58e5-4928-bdf2-4f0f7cb4cd56 HTTP/1.1" status: 200 len: 210 time: 0.0273333 Nov 08 16:15:27.054062 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f0a9517-7fa1-4ac1-b26e-ca289ec24cda req-16253a30-3c82-46e8-b894-d9d1f005518b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:27.055674 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4f0a9517-7fa1-4ac1-b26e-ca289ec24cda req-16253a30-3c82-46e8-b894-d9d1f005518b tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0505908 Nov 08 16:15:27.127331 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4f0a9517-7fa1-4ac1-b26e-ca289ec24cda req-cf22bdff-1892-4169-8a4f-90361259785e tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0640697 Nov 08 16:15:27.233139 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8209770c-5509-4bb7-80f5-a017e8b39f9f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:27.234529 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8209770c-5509-4bb7-80f5-a017e8b39f9f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.25 "GET /v2.0/networks?id=63da175a-847c-472d-b285-2df5d0b798a0 HTTP/1.1" status: 200 len: 813 time: 0.1061137 Nov 08 16:15:27.257140 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-ed4a574d-dc8e-4386-aacd-baa54f5cf416 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Request body: {'port': {'device_id': '116d828b-58e5-4928-bdf2-4f0f7cb4cd56', 'network_id': '63da175a-847c-472d-b285-2df5d0b798a0', 'admin_state_up': True, 'tenant_id': 'e5e827086bb348d190546b9a0c0ba087'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:15:27.390808 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e475be4b-9beb-4794-b5a8-ea5340d47c65 req-3b89fd5b-faec-4c3a-a1ba-315ecfd05230 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=116d828b-58e5-4928-bdf2-4f0f7cb4cd56 HTTP/1.1" status: 200 len: 210 time: 0.0350471 Nov 08 16:15:27.399842 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-ed4a574d-dc8e-4386-aacd-baa54f5cf416 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Made reservation on behalf of e5e827086bb348d190546b9a0c0ba087 for: {'port': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:15:27.403292 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-ed4a574d-dc8e-4386-aacd-baa54f5cf416 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:27.524287 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-ed4a574d-dc8e-4386-aacd-baa54f5cf416 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Allocated IP 172.20.0.11 (63da175a-847c-472d-b285-2df5d0b798a0/1f439244-c92a-4099-b428-ff553d72eb05/f510df50-3aa6-4a56-a3f6-1075cc078430) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:15:27.670718 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-ed4a574d-dc8e-4386-aacd-baa54f5cf416 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:27.703881 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-ed4a574d-dc8e-4386-aacd-baa54f5cf416 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:27.744282 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-ed4a574d-dc8e-4386-aacd-baa54f5cf416 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Network 63da175a-847c-472d-b285-2df5d0b798a0 is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:15:27.749394 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-ed4a574d-dc8e-4386-aacd-baa54f5cf416 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:15:27.753585 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-ed4a574d-dc8e-4386-aacd-baa54f5cf416 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:15:27.786063 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed4a574d-dc8e-4386-aacd-baa54f5cf416 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Pushing event updated for resources: {'Port': ['ID=f510df50-3aa6-4a56-a3f6-1075cc078430,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:27.810568 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-ed4a574d-dc8e-4386-aacd-baa54f5cf416 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:27.811209 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-ed4a574d-dc8e-4386-aacd-baa54f5cf416 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:27.827906 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-ed4a574d-dc8e-4386-aacd-baa54f5cf416 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5790324 Nov 08 16:15:27.864521 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8d0ad121-7a98-481c-855f-74a7643bf121 service neutron] Request body: {'port': {'device_id': '116d828b-58e5-4928-bdf2-4f0f7cb4cd56', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81618'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:15:27.916786 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8d0ad121-7a98-481c-855f-74a7643bf121 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:28.164834 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8d0ad121-7a98-481c-855f-74a7643bf121 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f510df50-3aa6-4a56-a3f6-1075cc078430 {{(pid=101244) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:15:28.172174 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8d0ad121-7a98-481c-855f-74a7643bf121 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:28.184603 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.provisioning_blocks [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8d0ad121-7a98-481c-855f-74a7643bf121 service neutron] Transition to ACTIVE for port object f510df50-3aa6-4a56-a3f6-1075cc078430 will not be triggered until provisioned by entity L2. {{(pid=101244) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 16:15:28.188189 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8d0ad121-7a98-481c-855f-74a7643bf121 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:28.268707 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d0ad121-7a98-481c-855f-74a7643bf121 service neutron] Pushing event updated for resources: {'Port': ['ID=f510df50-3aa6-4a56-a3f6-1075cc078430,revision_number=2']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:28.320263 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bd0d532-e61d-4cde-8b8b-bcc40305bd9d req-87fe1585-310a-490e-928d-fe692db99c58 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:28.321793 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0bd0d532-e61d-4cde-8b8b-bcc40305bd9d req-87fe1585-310a-490e-928d-fe692db99c58 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.1256237 Nov 08 16:15:28.374034 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8d0ad121-7a98-481c-855f-74a7643bf121 service neutron] Attempting to bind port f510df50-3aa6-4a56-a3f6-1075cc078430 on host hv-cinder-81618 for vnic_type normal with profile {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:15:28.374372 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8d0ad121-7a98-481c-855f-74a7643bf121 service neutron] Attempting to bind port f510df50-3aa6-4a56-a3f6-1075cc078430 by drivers openvswitch,hyperv on host hv-cinder-81618 at level 0 using segments [{'id': 'd89c6b3f-ecc6-4296-92e8-9f4a30c70af3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': '63da175a-847c-472d-b285-2df5d0b798a0'}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:15:28.374690 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8d0ad121-7a98-481c-855f-74a7643bf121 service neutron] Attempting to bind port f510df50-3aa6-4a56-a3f6-1075cc078430 on network 63da175a-847c-472d-b285-2df5d0b798a0 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:15:28.385194 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8d0ad121-7a98-481c-855f-74a7643bf121 service neutron] Port f510df50-3aa6-4a56-a3f6-1075cc078430 on network 63da175a-847c-472d-b285-2df5d0b798a0 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81618 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 16:15:28.385513 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8d0ad121-7a98-481c-855f-74a7643bf121 service neutron] Attempting to bind port f510df50-3aa6-4a56-a3f6-1075cc078430 on network 63da175a-847c-472d-b285-2df5d0b798a0 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:15:28.392223 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0bd0d532-e61d-4cde-8b8b-bcc40305bd9d req-5c71575b-7f57-4157-9e3b-17d040b87c15 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/security-groups?id=b296658b-8eb6-4f30-aeff-34c29a116b94&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0647199 Nov 08 16:15:28.395381 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8d0ad121-7a98-481c-855f-74a7643bf121 service neutron] Checking agent: {'id': '54bf9779-c14d-412a-90fc-96b4a6589d5a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81618', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'started_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 15, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:15:28.395709 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8d0ad121-7a98-481c-855f-74a7643bf121 service neutron] Checking segment: {'id': 'd89c6b3f-ecc6-4296-92e8-9f4a30c70af3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': '63da175a-847c-472d-b285-2df5d0b798a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:15:28.396076 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8d0ad121-7a98-481c-855f-74a7643bf121 service neutron] Bound using segment: {'id': 'd89c6b3f-ecc6-4296-92e8-9f4a30c70af3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': '63da175a-847c-472d-b285-2df5d0b798a0'} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:15:28.396496 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8d0ad121-7a98-481c-855f-74a7643bf121 service neutron] Bound port: f510df50-3aa6-4a56-a3f6-1075cc078430, host: hv-cinder-81618, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd89c6b3f-ecc6-4296-92e8-9f4a30c70af3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': '63da175a-847c-472d-b285-2df5d0b798a0'}}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:15:28.396844 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8d0ad121-7a98-481c-855f-74a7643bf121 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:28.417916 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7078c27e-0b01-48bf-be20-dc07a8112575 req-cfcdb8f0-4fd5-4566-b30d-942b6cb5e798 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:28.420336 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-7078c27e-0b01-48bf-be20-dc07a8112575 req-cfcdb8f0-4fd5-4566-b30d-942b6cb5e798 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.25 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 945 time: 0.0560312 Nov 08 16:15:28.510793 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8d0ad121-7a98-481c-855f-74a7643bf121 service neutron] For port f510df50-3aa6-4a56-a3f6-1075cc078430, host hv-cinder-81618, cleared binding levels {{(pid=101244) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:15:28.527665 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8d0ad121-7a98-481c-855f-74a7643bf121 service neutron] For port f510df50-3aa6-4a56-a3f6-1075cc078430, host hv-cinder-81618, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=f510df50-3aa6-4a56-a3f6-1075cc078430,segment=NetworkSegment(d89c6b3f-ecc6-4296-92e8-9f4a30c70af3),segment_id=d89c6b3f-ecc6-4296-92e8-9f4a30c70af3)] {{(pid=101244) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:15:28.533384 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [req-7078c27e-0b01-48bf-be20-dc07a8112575 req-47745eb7-69a7-40bf-b513-d122f96adb27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Deleting port 17db566c-bf28-4091-b7f6-4ffa5f80c982 {{(pid=101245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:15:28.533737 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-7078c27e-0b01-48bf-be20-dc07a8112575 req-47745eb7-69a7-40bf-b513-d122f96adb27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:28.536070 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8d0ad121-7a98-481c-855f-74a7643bf121 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:28.579987 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d8a4942-b739-46e8-8aec-260f9946991f req-b2af9b5b-fe94-49f6-ab76-6f0ecc613766 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:28.581750 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1d8a4942-b739-46e8-8aec-260f9946991f req-b2af9b5b-fe94-49f6-ab76-6f0ecc613766 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=116d828b-58e5-4928-bdf2-4f0f7cb4cd56 HTTP/1.1" status: 200 len: 944 time: 0.1010370 Nov 08 16:15:28.588395 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8d0ad121-7a98-481c-855f-74a7643bf121 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:28.588950 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8d0ad121-7a98-481c-855f-74a7643bf121 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:28.590393 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8d0ad121-7a98-481c-855f-74a7643bf121 service neutron] 10.222.0.25 "PUT /v2.0/ports/f510df50-3aa6-4a56-a3f6-1075cc078430 HTTP/1.1" status: 200 len: 1094 time: 0.7304947 Nov 08 16:15:28.590844 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '116d828b-58e5-4928-bdf2-4f0f7cb4cd56', 'tag': 'f510df50-3aa6-4a56-a3f6-1075cc078430'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:15:28.593145 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bb505b0f-430c-4da6-b49e-eebd60fd5303" -d '{"events": [{"name": "network-changed", "server_uuid": "116d828b-58e5-4928-bdf2-4f0f7cb4cd56", "tag": "f510df50-3aa6-4a56-a3f6-1075cc078430"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:15:28.642040 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d0ad121-7a98-481c-855f-74a7643bf121 service neutron] Pushing event updated for resources: {'Port': ['ID=f510df50-3aa6-4a56-a3f6-1075cc078430,revision_number=3']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:28.643801 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [req-7078c27e-0b01-48bf-be20-dc07a8112575 req-47745eb7-69a7-40bf-b513-d122f96adb27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] For port 17db566c-bf28-4091-b7f6-4ffa5f80c982, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=17db566c-bf28-4091-b7f6-4ffa5f80c982,segment=NetworkSegment(e14404ea-b710-490a-b578-a605dfc73350),segment_id=e14404ea-b710-490a-b578-a605dfc73350)] {{(pid=101245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:15:28.644559 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-7078c27e-0b01-48bf-be20-dc07a8112575 req-47745eb7-69a7-40bf-b513-d122f96adb27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:28.659718 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [req-7078c27e-0b01-48bf-be20-dc07a8112575 req-47745eb7-69a7-40bf-b513-d122f96adb27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Calling delete_port for 17db566c-bf28-4091-b7f6-4ffa5f80c982 owned by compute:nova {{(pid=101245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:15:28.671080 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1d8a4942-b739-46e8-8aec-260f9946991f req-cfd951d9-c5a3-4b7a-9901-58c73959b147 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0742605 Nov 08 16:15:28.673077 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:15:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6588d869-93cf-40b9-badf-856648b5b463 x-openstack-request-id: req-6588d869-93cf-40b9-badf-856648b5b463 {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:15:28.673588 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "116d828b-58e5-4928-bdf2-4f0f7cb4cd56", "tag": "f510df50-3aa6-4a56-a3f6-1075cc078430", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:15:28.673943 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-6588d869-93cf-40b9-badf-856648b5b463 {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:15:28.674449 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '116d828b-58e5-4928-bdf2-4f0f7cb4cd56', 'tag': 'f510df50-3aa6-4a56-a3f6-1075cc078430', 'status': 'completed', 'code': 200} Nov 08 16:15:28.791209 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb505b0f-430c-4da6-b49e-eebd60fd5303 req-1a353ad7-7b93-405f-bed3-ba763c1a7b1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:28.792744 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bb505b0f-430c-4da6-b49e-eebd60fd5303 req-1a353ad7-7b93-405f-bed3-ba763c1a7b1f service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e5e827086bb348d190546b9a0c0ba087&device_id=116d828b-58e5-4928-bdf2-4f0f7cb4cd56 HTTP/1.1" status: 200 len: 1097 time: 0.0459571 Nov 08 16:15:28.808546 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-7078c27e-0b01-48bf-be20-dc07a8112575 req-47745eb7-69a7-40bf-b513-d122f96adb27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:28.820614 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['17db566c-bf28-4091-b7f6-4ffa5f80c982'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:15:28.844837 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47745eb7-69a7-40bf-b513-d122f96adb27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Pushing event deleted for resources: {'Port': ['ID=17db566c-bf28-4091-b7f6-4ffa5f80c982,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:28.873827 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47745eb7-69a7-40bf-b513-d122f96adb27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:15:28.874169 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47745eb7-69a7-40bf-b513-d122f96adb27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:15:28.874680 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47745eb7-69a7-40bf-b513-d122f96adb27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:15:28.875146 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47745eb7-69a7-40bf-b513-d122f96adb27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:15:28.875478 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47745eb7-69a7-40bf-b513-d122f96adb27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:15:28.875812 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47745eb7-69a7-40bf-b513-d122f96adb27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:15:28.876134 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47745eb7-69a7-40bf-b513-d122f96adb27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:15:28.876455 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47745eb7-69a7-40bf-b513-d122f96adb27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:15:28.876774 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47745eb7-69a7-40bf-b513-d122f96adb27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:15:28.877247 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47745eb7-69a7-40bf-b513-d122f96adb27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:15:28.877773 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47745eb7-69a7-40bf-b513-d122f96adb27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:15:28.878101 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47745eb7-69a7-40bf-b513-d122f96adb27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:15:28.906659 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [req-7078c27e-0b01-48bf-be20-dc07a8112575 req-47745eb7-69a7-40bf-b513-d122f96adb27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] No DVR routers for this DVR port 17db566c-bf28-4091-b7f6-4ffa5f80c982 on host hv-cinder-81618 {{(pid=101245) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:15:28.913147 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [req-7078c27e-0b01-48bf-be20-dc07a8112575 req-47745eb7-69a7-40bf-b513-d122f96adb27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:28.913265 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb505b0f-430c-4da6-b49e-eebd60fd5303 req-ac2ca5bb-8199-4dea-8152-ac33de686efc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:28.914679 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bb505b0f-430c-4da6-b49e-eebd60fd5303 req-ac2ca5bb-8199-4dea-8152-ac33de686efc service neutron] 10.222.0.25 "GET /v2.0/networks?tenant_id=e5e827086bb348d190546b9a0c0ba087&shared=False HTTP/1.1" status: 200 len: 914 time: 0.1127331 Nov 08 16:15:28.916492 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-7078c27e-0b01-48bf-be20-dc07a8112575 req-47745eb7-69a7-40bf-b513-d122f96adb27 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.25 "DELETE /v2.0/ports/17db566c-bf28-4091-b7f6-4ffa5f80c982 HTTP/1.1" status: 204 len: 173 time: 0.4862509 Nov 08 16:15:28.918439 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '44f7e3a8-0064-42ad-9e41-03a1ba050703', 'name': 'network-vif-deleted', 'tag': '17db566c-bf28-4091-b7f6-4ffa5f80c982'}] {{(pid=101245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:15:28.920696 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9303bddee447de525cefc409d3d14f9dbe8ef1f21bfe9eb24fdef2609d4aa3c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-117e15a0-68f3-4d6d-9ade-06e0895f9f6a" -d '{"events": [{"server_uuid": "44f7e3a8-0064-42ad-9e41-03a1ba050703", "name": "network-vif-deleted", "tag": "17db566c-bf28-4091-b7f6-4ffa5f80c982"}]}' {{(pid=101245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:15:29.024357 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb505b0f-430c-4da6-b49e-eebd60fd5303 req-f529394f-d523-4946-b3ee-7e82c513c27c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:29.026082 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bb505b0f-430c-4da6-b49e-eebd60fd5303 req-f529394f-d523-4946-b3ee-7e82c513c27c service neutron] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1004167 Nov 08 16:15:29.055005 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:15:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-31140195-9c13-42a8-a18c-f098138d59cd x-openstack-request-id: req-31140195-9c13-42a8-a18c-f098138d59cd {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:15:29.055286 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "44f7e3a8-0064-42ad-9e41-03a1ba050703", "name": "network-vif-deleted", "tag": "17db566c-bf28-4091-b7f6-4ffa5f80c982", "status": "completed", "code": 200}]} {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:15:29.055530 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-31140195-9c13-42a8-a18c-f098138d59cd {{(pid=101245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:15:29.055948 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '44f7e3a8-0064-42ad-9e41-03a1ba050703', 'name': 'network-vif-deleted', 'tag': '17db566c-bf28-4091-b7f6-4ffa5f80c982', 'status': 'completed', 'code': 200} Nov 08 16:15:29.166480 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8bb6675a-73a9-4510-a417-0bd3fe09a082 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:29.167846 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-8bb6675a-73a9-4510-a417-0bd3fe09a082 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e5e827086bb348d190546b9a0c0ba087&device_id=116d828b-58e5-4928-bdf2-4f0f7cb4cd56 HTTP/1.1" status: 200 len: 1097 time: 0.0394540 Nov 08 16:15:29.211274 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-942d8870-e83e-4a74-bc71-482a476557a8 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=f510df50-3aa6-4a56-a3f6-1075cc078430 HTTP/1.1" status: 200 len: 217 time: 0.0352561 Nov 08 16:15:29.262515 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-7172134d-f1d5-4611-b67f-c48b5026d3ae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:29.263881 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-7172134d-f1d5-4611-b67f-c48b5026d3ae service neutron] 10.222.0.25 "GET /v2.0/subnets?id=1f439244-c92a-4099-b428-ff553d72eb05 HTTP/1.1" status: 200 len: 853 time: 0.0408838 Nov 08 16:15:29.294386 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-0664b3f9-50b7-4080-a1f6-6eb00ac93460 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=63da175a-847c-472d-b285-2df5d0b798a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0227211 Nov 08 16:15:29.605881 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b99488a1-9ac6-4cd0-87c9-86c43c46f0f5 req-5c9126b2-bad0-4752-89d8-caaca7f6b7a4 tempest-ServerRescueNegativeTestJSON-1528723205 tempest-ServerRescueNegativeTestJSON-1528723205-project] 10.222.0.37 "GET /v2.0/ports?device_id=44f7e3a8-0064-42ad-9e41-03a1ba050703 HTTP/1.1" status: 200 len: 210 time: 0.0357449 Nov 08 16:15:29.626440 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-9e1bc2dd-b193-4dd3-94a1-c682144b378d service neutron] 10.222.0.25 "GET /v2.0/networks/63da175a-847c-472d-b285-2df5d0b798a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3158059 Nov 08 16:15:29.716526 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f847931b-ceb1-40d3-b244-ce7bd0a18ab3 req-95c204c6-c077-43a4-b850-844c08dd9d7e service neutron] 10.222.0.25 "GET /v2.0/networks/63da175a-847c-472d-b285-2df5d0b798a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0819235 Nov 08 16:15:29.795989 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83beedb5-a2ed-4eef-84bd-ade7801ce82c req-970879a0-31d5-4ffa-aa32-9000e4e2be4b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:29.797434 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-83beedb5-a2ed-4eef-84bd-ade7801ce82c req-970879a0-31d5-4ffa-aa32-9000e4e2be4b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=116d828b-58e5-4928-bdf2-4f0f7cb4cd56 HTTP/1.1" status: 200 len: 944 time: 0.0529797 Nov 08 16:15:29.847215 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-83beedb5-a2ed-4eef-84bd-ade7801ce82c req-33729a85-8ddd-482e-942b-613800dec7ef tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430598 Nov 08 16:15:30.779295 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 37224) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:31.017111 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36e441c5-c9a1-420a-8ad8-b1eac40efce8 req-f9889d31-a3aa-4e67-a05f-6a21e785d0a3 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:31.019326 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-36e441c5-c9a1-420a-8ad8-b1eac40efce8 req-f9889d31-a3aa-4e67-a05f-6a21e785d0a3 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=116d828b-58e5-4928-bdf2-4f0f7cb4cd56 HTTP/1.1" status: 200 len: 944 time: 0.0931132 Nov 08 16:15:31.093263 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 17db566c-bf28-4091-b7f6-4ffa5f80c982 no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:15:31.121308 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] No Port match for: 17db566c-bf28-4091-b7f6-4ffa5f80c982 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:15:31.122872 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 17db566c-bf28-4091-b7f6-4ffa5f80c982 not bound to the agent host hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:15:31.132491 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-36e441c5-c9a1-420a-8ad8-b1eac40efce8 req-5bb602dd-e22f-4b77-bada-53defb72ea76 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0959187 Nov 08 16:15:31.271953 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-755081b7-513f-43e3-aacf-2d96bd1e0ab6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-2033295'] for router_interface, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:31.552941 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-755081b7-513f-43e3-aacf-2d96bd1e0ab6 admin admin] Deleting port 8c0c4f72-e955-4eba-bada-1276c931cd7f {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:15:31.553269 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-755081b7-513f-43e3-aacf-2d96bd1e0ab6 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:31.629483 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [None req-755081b7-513f-43e3-aacf-2d96bd1e0ab6 admin admin] For port 8c0c4f72-e955-4eba-bada-1276c931cd7f, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=8c0c4f72-e955-4eba-bada-1276c931cd7f,segment=NetworkSegment(e14404ea-b710-490a-b578-a605dfc73350),segment_id=e14404ea-b710-490a-b578-a605dfc73350)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:15:31.629878 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-755081b7-513f-43e3-aacf-2d96bd1e0ab6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:31.642069 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-755081b7-513f-43e3-aacf-2d96bd1e0ab6 admin admin] Calling delete_port for 8c0c4f72-e955-4eba-bada-1276c931cd7f owned by network:router_interface {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:15:31.819970 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-755081b7-513f-43e3-aacf-2d96bd1e0ab6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:31.845555 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-755081b7-513f-43e3-aacf-2d96bd1e0ab6 admin admin] Pushing event deleted for resources: {'Port': ['ID=8c0c4f72-e955-4eba-bada-1276c931cd7f,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:31.998131 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-755081b7-513f-43e3-aacf-2d96bd1e0ab6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1599532', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-2034495'] for router_interface, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:32.201319 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-755081b7-513f-43e3-aacf-2d96bd1e0ab6 admin admin] Router cc1c69bc-09ff-4004-b958-600b83b84026 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:15:32.290089 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ac90d48-0d78-4dbc-8011-2939dc64f59a req-2b67b919-bf3c-44f9-b2f0-6ca96feb8765 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:32.291557 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7ac90d48-0d78-4dbc-8011-2939dc64f59a req-2b67b919-bf3c-44f9-b2f0-6ca96feb8765 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=116d828b-58e5-4928-bdf2-4f0f7cb4cd56 HTTP/1.1" status: 200 len: 944 time: 0.0891967 Nov 08 16:15:32.585723 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-755081b7-513f-43e3-aacf-2d96bd1e0ab6 admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:15:32.593463 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-755081b7-513f-43e3-aacf-2d96bd1e0ab6 admin admin] 10.222.0.37 "PUT /v2.0/routers/cc1c69bc-09ff-4004-b958-600b83b84026/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8129194 Nov 08 16:15:32.596098 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 37264) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:32.598983 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7ac90d48-0d78-4dbc-8011-2939dc64f59a req-ea5d6407-78fb-4943-b2e1-19305e196a62 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0631301 Nov 08 16:15:32.600869 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db6240e9-09c5-4952-b8f8-757244a60c2e None None] Sync routers for ids ['cc1c69bc-09ff-4004-b958-600b83b84026'] in dv-cinder-816187-2-iscsi {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:15:32.613205 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db6240e9-09c5-4952-b8f8-757244a60c2e None None] Routers {'cc1c69bc-09ff-4004-b958-600b83b84026'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:15:32.614084 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-db6240e9-09c5-4952-b8f8-757244a60c2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:15:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['cc1c69bc-09ff-4004-b958-600b83b84026'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:15:32.721656 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e0df2efb-b85c-4f74-bf5b-c4f7c1fc8ef5 admin admin] Publish callbacks [] for router, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:32.724779 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-db6240e9-09c5-4952-b8f8-757244a60c2e None None] Set router cc1c69bc-09ff-4004-b958-600b83b84026 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:15:32.829458 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e0df2efb-b85c-4f74-bf5b-c4f7c1fc8ef5 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:32.881904 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-e0df2efb-b85c-4f74-bf5b-c4f7c1fc8ef5 admin admin] Deleting port 08dc39b4-7c2e-4499-b08d-d80c11a6d6ca {{(pid=101245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:15:32.882133 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e0df2efb-b85c-4f74-bf5b-c4f7c1fc8ef5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:32.897390 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-db6240e9-09c5-4952-b8f8-757244a60c2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc1c69bc-09ff-4004-b958-600b83b84026', 'name': 'tempest-ServerRescueNegativeTestJSON-593854580-router', 'tenant_id': '4818358a827143eb9ace58a26713cdf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.169'}], 'enable_snat': True}, 'gw_port_id': '08dc39b4-7c2e-4499-b08d-d80c11a6d6ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:15:31Z', 'revision_number': 5, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'gw_port': {'id': '08dc39b4-7c2e-4499-b08d-d80c11a6d6ca', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:2d:58:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc1c69bc-09ff-4004-b958-600b83b84026', 'device_owner': 'network:router_gateway', 'standard_attr_id': 98, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:08Z', 'updated_at': '2021-11-08T16:11:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:15:32.922177 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db6240e9-09c5-4952-b8f8-757244a60c2e None None] Checking router: cc1c69bc-09ff-4004-b958-600b83b84026 for host: dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:15:32.931565 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db6240e9-09c5-4952-b8f8-757244a60c2e None None] Routers {'cc1c69bc-09ff-4004-b958-600b83b84026'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:15:32.932225 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-db6240e9-09c5-4952-b8f8-757244a60c2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:15:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['cc1c69bc-09ff-4004-b958-600b83b84026'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:15:32.980532 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [None req-e0df2efb-b85c-4f74-bf5b-c4f7c1fc8ef5 admin admin] For port 08dc39b4-7c2e-4499-b08d-d80c11a6d6ca, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=08dc39b4-7c2e-4499-b08d-d80c11a6d6ca,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:15:32.981031 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e0df2efb-b85c-4f74-bf5b-c4f7c1fc8ef5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:32.993628 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-e0df2efb-b85c-4f74-bf5b-c4f7c1fc8ef5 admin admin] Calling delete_port for 08dc39b4-7c2e-4499-b08d-d80c11a6d6ca owned by network:router_gateway {{(pid=101245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:15:33.019665 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-db6240e9-09c5-4952-b8f8-757244a60c2e None None] Set router cc1c69bc-09ff-4004-b958-600b83b84026 gateway port host: None {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:15:33.156197 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-db6240e9-09c5-4952-b8f8-757244a60c2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc1c69bc-09ff-4004-b958-600b83b84026', 'name': 'tempest-ServerRescueNegativeTestJSON-593854580-router', 'tenant_id': '4818358a827143eb9ace58a26713cdf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:15:32Z', 'revision_number': 6, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'gw_port_host': None}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:15:33.161272 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e0df2efb-b85c-4f74-bf5b-c4f7c1fc8ef5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:33.182801 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db6240e9-09c5-4952-b8f8-757244a60c2e None None] The sync data for ids ['cc1c69bc-09ff-4004-b958-600b83b84026'] in dv-cinder-816187-2-iscsi is: [{'id': 'cc1c69bc-09ff-4004-b958-600b83b84026', 'name': 'tempest-ServerRescueNegativeTestJSON-593854580-router', 'tenant_id': '4818358a827143eb9ace58a26713cdf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:15:32Z', 'revision_number': 6, 'project_id': '4818358a827143eb9ace58a26713cdf0', 'gw_port_host': None}] {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:15:33.183655 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0df2efb-b85c-4f74-bf5b-c4f7c1fc8ef5 admin admin] Pushing event deleted for resources: {'Port': ['ID=08dc39b4-7c2e-4499-b08d-d80c11a6d6ca,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:33.244430 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e0df2efb-b85c-4f74-bf5b-c4f7c1fc8ef5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-2032325'] for router_gateway, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:33.344621 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e0df2efb-b85c-4f74-bf5b-c4f7c1fc8ef5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-2034023', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-12866'] for router, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:33.346939 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e0df2efb-b85c-4f74-bf5b-c4f7c1fc8ef5 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:33.405518 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e0df2efb-b85c-4f74-bf5b-c4f7c1fc8ef5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-2034044'] for router, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:33.406047 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e0df2efb-b85c-4f74-bf5b-c4f7c1fc8ef5 admin admin] Fanout notify agent at l3_agent the message router_deleted on router cc1c69bc-09ff-4004-b958-600b83b84026 {{(pid=101245) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 08 16:15:33.410843 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e0df2efb-b85c-4f74-bf5b-c4f7c1fc8ef5 admin admin] Publish callbacks [] for router, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:33.411962 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-e0df2efb-b85c-4f74-bf5b-c4f7c1fc8ef5 admin admin] 10.222.0.37 "DELETE /v2.0/routers/cc1c69bc-09ff-4004-b958-600b83b84026 HTTP/1.1" status: 204 len: 168 time: 0.8148119 Nov 08 16:15:33.414440 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 37274) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:33.455775 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_v2 [None req-089cd0f3-717e-4989-8a56-1cefcc10ad79 admin admin] Deleting subnet 6936707c-bd3f-4cd8-9462-a4af0ea16ed8 {{(pid=101245) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 16:15:33.459250 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-089cd0f3-717e-4989-8a56-1cefcc10ad79 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:33.493562 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-089cd0f3-717e-4989-8a56-1cefcc10ad79 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5113603'] for subnet, precommit_delete_associations {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:33.533186 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-089cd0f3-717e-4989-8a56-1cefcc10ad79 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-872226'] for subnet, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:33.585195 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-089cd0f3-717e-4989-8a56-1cefcc10ad79 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-872235', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7464090', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6098572'] for subnet, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:33.608527 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-089cd0f3-717e-4989-8a56-1cefcc10ad79 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6936707c-bd3f-4cd8-9462-a4af0ea16ed8,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:33.619581 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-089cd0f3-717e-4989-8a56-1cefcc10ad79 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:33.623466 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-089cd0f3-717e-4989-8a56-1cefcc10ad79 admin admin] 10.222.0.37 "DELETE /v2.0/subnets/6936707c-bd3f-4cd8-9462-a4af0ea16ed8 HTTP/1.1" status: 204 len: 168 time: 0.2081149 Nov 08 16:15:33.626082 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 37278) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:33.640551 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 8c0c4f72-e955-4eba-bada-1276c931cd7f no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:15:33.664383 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: 8c0c4f72-e955-4eba-bada-1276c931cd7f {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:15:33.664926 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 8c0c4f72-e955-4eba-bada-1276c931cd7f not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:15:33.702296 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3dc6b7e7-2119-4b8c-a040-6a44b926604c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1007047'] for network, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:33.743168 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e5722ed-6c00-4b9a-8174-2e67d527a490 req-3b42061d-e0dd-4d57-ae56-12091241301c tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:33.744662 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4e5722ed-6c00-4b9a-8174-2e67d527a490 req-3b42061d-e0dd-4d57-ae56-12091241301c tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=116d828b-58e5-4928-bdf2-4f0f7cb4cd56 HTTP/1.1" status: 200 len: 944 time: 0.0494432 Nov 08 16:15:33.782371 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3dc6b7e7-2119-4b8c-a040-6a44b926604c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-869719', 'neutron.services.segments.db._delete_segments_for_network-8792877333297'] for network, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:33.799214 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4e5722ed-6c00-4b9a-8174-2e67d527a490 req-c5731d33-9605-40c2-829d-fe967a5118b5 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393810 Nov 08 16:15:33.802106 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.services.segments.db [None req-3dc6b7e7-2119-4b8c-a040-6a44b926604c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2d5b5768-37f3-49a1-b451-2803f6f97429']}} {{(pid=101245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:15:33.811061 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.services.segments.db [None req-3dc6b7e7-2119-4b8c-a040-6a44b926604c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e14404ea-b710-490a-b578-a605dfc73350') {'for_net_delete': True} {{(pid=101245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:15:33.811356 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.services.segments.db [None req-3dc6b7e7-2119-4b8c-a040-6a44b926604c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e14404ea-b710-490a-b578-a605dfc73350') {} {{(pid=101245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:15:33.824439 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3dc6b7e7-2119-4b8c-a040-6a44b926604c admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792877333818', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5113626'] for segment, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:33.839523 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3dc6b7e7-2119-4b8c-a040-6a44b926604c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:33.845404 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3dc6b7e7-2119-4b8c-a040-6a44b926604c admin admin] Releasing vlan 164 on physical network physnet1 to pool {{(pid=101245) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 16:15:33.845875 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3dc6b7e7-2119-4b8c-a040-6a44b926604c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7464060'] for segment, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: Traceback (most recent call last): Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: timer() Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: cb(*args, **kw) Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: return func(*args, **kwargs) Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: self._notify() Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: self.callback(batched_events) Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: event.method(event) Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: return f(self, *a, **k) Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: return self._get(url).json() Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: return self.request(url, 'GET', **kwargs) Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 16:15:33.847535 dv-cinder-816187-2-iscsi neutron-server[101245]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 16:15:33.898418 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3dc6b7e7-2119-4b8c-a040-6a44b926604c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-868772', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-2032313'] for network, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:33.903658 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3dc6b7e7-2119-4b8c-a040-6a44b926604c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:33.907000 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-3dc6b7e7-2119-4b8c-a040-6a44b926604c admin admin] 10.222.0.37 "DELETE /v2.0/networks/2d5b5768-37f3-49a1-b451-2803f6f97429 HTTP/1.1" status: 204 len: 168 time: 0.2798431 Nov 08 16:15:33.917520 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dc6b7e7-2119-4b8c-a040-6a44b926604c admin admin] Pushing event deleted for resources: {'Network': ['ID=2d5b5768-37f3-49a1-b451-2803f6f97429,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:34.069021 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 37286) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:34.117766 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-d1dbce4a-462f-475f-88db-7b0e047099ba admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=4818358a827143eb9ace58a26713cdf0&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0460000 Nov 08 16:15:34.118659 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 37292) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:15:34.167646 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-dafc0c81-470d-40a5-9154-76c0611a3606 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:34.190478 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-dafc0c81-470d-40a5-9154-76c0611a3606 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:34.241479 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-dafc0c81-470d-40a5-9154-76c0611a3606 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:34.244428 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-dafc0c81-470d-40a5-9154-76c0611a3606 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:34.245562 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-dafc0c81-470d-40a5-9154-76c0611a3606 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/b296658b-8eb6-4f30-aeff-34c29a116b94 HTTP/1.1" status: 204 len: 168 time: 0.1259325 Nov 08 16:15:34.254407 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dafc0c81-470d-40a5-9154-76c0611a3606 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b296658b-8eb6-4f30-aeff-34c29a116b94,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:34.926650 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a27627a-d1c9-49a5-8601-a9ac5609aa04 req-d46c4421-68f0-4d4f-b7d9-114452dfb295 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:34.928476 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5a27627a-d1c9-49a5-8601-a9ac5609aa04 req-d46c4421-68f0-4d4f-b7d9-114452dfb295 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=116d828b-58e5-4928-bdf2-4f0f7cb4cd56 HTTP/1.1" status: 200 len: 944 time: 0.0580058 Nov 08 16:15:34.977880 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5a27627a-d1c9-49a5-8601-a9ac5609aa04 req-3f271df1-1878-493a-8904-90e25a234677 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429718 Nov 08 16:15:35.115309 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device f510df50-3aa6-4a56-a3f6-1075cc078430 details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:15:35.225823 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port f510df50-3aa6-4a56-a3f6-1075cc078430, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=f510df50-3aa6-4a56-a3f6-1075cc078430,segment=NetworkSegment(d89c6b3f-ecc6-4296-92e8-9f4a30c70af3),segment_id=d89c6b3f-ecc6-4296-92e8-9f4a30c70af3)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:15:35.242525 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': 'f510df50-3aa6-4a56-a3f6-1075cc078430', 'network_id': '63da175a-847c-472d-b285-2df5d0b798a0', 'port_id': 'f510df50-3aa6-4a56-a3f6-1075cc078430', 'mac_address': 'fa:16:3e:ed:c9:2c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 155, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1f439244-c92a-4099-b428-ff553d72eb05', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:15:35.285730 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:35.297975 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f510df50-3aa6-4a56-a3f6-1075cc078430 {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:15:35.317944 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port f510df50-3aa6-4a56-a3f6-1075cc078430, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=f510df50-3aa6-4a56-a3f6-1075cc078430,segment=NetworkSegment(d89c6b3f-ecc6-4296-92e8-9f4a30c70af3),segment_id=d89c6b3f-ecc6-4296-92e8-9f4a30c70af3)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:15:35.321779 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:35.370480 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=f510df50-3aa6-4a56-a3f6-1075cc078430,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:35.378962 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:15:35.379328 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:15:35.379670 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:15:35.380007 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:15:35.380320 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:15:35.380648 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:15:35.380970 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:15:35.381293 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:15:35.381632 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:15:35.381977 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:15:35.382335 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:15:35.382639 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:15:35.412410 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 08dc39b4-7c2e-4499-b08d-d80c11a6d6ca no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:15:35.432527 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: 08dc39b4-7c2e-4499-b08d-d80c11a6d6ca {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:15:35.432800 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 08dc39b4-7c2e-4499-b08d-d80c11a6d6ca not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:15:35.892948 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['f510df50-3aa6-4a56-a3f6-1075cc078430'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:15:36.093341 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8afdc1d-dc66-47ba-aeb3-a44ecd115c25 req-b5c07227-b5d4-4484-afa5-e8b776f459db tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:36.094848 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f8afdc1d-dc66-47ba-aeb3-a44ecd115c25 req-b5c07227-b5d4-4484-afa5-e8b776f459db tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=116d828b-58e5-4928-bdf2-4f0f7cb4cd56 HTTP/1.1" status: 200 len: 945 time: 0.0473471 Nov 08 16:15:36.141071 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f8afdc1d-dc66-47ba-aeb3-a44ecd115c25 req-a0699468-dba7-4e1f-9e24-341bbe210ed5 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403371 Nov 08 16:15:37.140493 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device f510df50-3aa6-4a56-a3f6-1075cc078430 up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:15:37.188202 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning for port f510df50-3aa6-4a56-a3f6-1075cc078430 completed by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 16:15:37.192068 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port f510df50-3aa6-4a56-a3f6-1075cc078430 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:15:37.192431 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:37.259397 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a535a21b-e709-4f82-a49c-3c9305ffd1e7 req-bff2e643-115b-4ebe-b7ac-f3e19b3e1cd6 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:37.261031 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a535a21b-e709-4f82-a49c-3c9305ffd1e7 req-bff2e643-115b-4ebe-b7ac-f3e19b3e1cd6 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=116d828b-58e5-4928-bdf2-4f0f7cb4cd56 HTTP/1.1" status: 200 len: 945 time: 0.0507510 Nov 08 16:15:37.275867 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:37.301349 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '116d828b-58e5-4928-bdf2-4f0f7cb4cd56', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f510df50-3aa6-4a56-a3f6-1075cc078430'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:15:37.304612 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4da82691-5bd1-48b3-b5f5-78b602edbe5b" -d '{"events": [{"server_uuid": "116d828b-58e5-4928-bdf2-4f0f7cb4cd56", "name": "network-vif-plugged", "status": "completed", "tag": "f510df50-3aa6-4a56-a3f6-1075cc078430"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:15:37.325095 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port f510df50-3aa6-4a56-a3f6-1075cc078430, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=f510df50-3aa6-4a56-a3f6-1075cc078430,segment=NetworkSegment(d89c6b3f-ecc6-4296-92e8-9f4a30c70af3),segment_id=d89c6b3f-ecc6-4296-92e8-9f4a30c70af3)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:15:37.332465 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a535a21b-e709-4f82-a49c-3c9305ffd1e7 req-7b7bee06-73d0-4228-b549-1866cb885bed tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0618594 Nov 08 16:15:37.334243 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:37.386035 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:15:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-08bee0a3-8d6e-499f-9a66-065127410a92 x-openstack-request-id: req-08bee0a3-8d6e-499f-9a66-065127410a92 {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:15:37.386410 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "116d828b-58e5-4928-bdf2-4f0f7cb4cd56", "name": "network-vif-plugged", "status": "completed", "tag": "f510df50-3aa6-4a56-a3f6-1075cc078430", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:15:37.386724 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-08bee0a3-8d6e-499f-9a66-065127410a92 {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:15:37.387319 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '116d828b-58e5-4928-bdf2-4f0f7cb4cd56', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f510df50-3aa6-4a56-a3f6-1075cc078430', 'code': 200} Nov 08 16:15:37.404455 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=f510df50-3aa6-4a56-a3f6-1075cc078430,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:15:37.563362 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dc8f29f-0b12-4027-8294-5aada3043897 req-c9fb6e27-0e56-4cdf-b180-eb0b3ba451c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:37.564849 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3dc8f29f-0b12-4027-8294-5aada3043897 req-c9fb6e27-0e56-4cdf-b180-eb0b3ba451c5 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=116d828b-58e5-4928-bdf2-4f0f7cb4cd56 HTTP/1.1" status: 200 len: 1099 time: 0.0402467 Nov 08 16:15:37.604791 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:15:37.615371 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3dc8f29f-0b12-4027-8294-5aada3043897 req-c9cf9114-919c-4b30-8794-afcc08370987 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423112 Nov 08 16:15:38.116639 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-c661dd7c-a156-4390-88eb-9c88868ced78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:38.463762 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5af4f38-9221-414a-bb0f-f78907536d2b req-20dbdfb3-a3d1-49c6-bdd9-1bf3385a3d5f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:38.465236 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b5af4f38-9221-414a-bb0f-f78907536d2b req-20dbdfb3-a3d1-49c6-bdd9-1bf3385a3d5f tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=116d828b-58e5-4928-bdf2-4f0f7cb4cd56 HTTP/1.1" status: 200 len: 946 time: 0.0486400 Nov 08 16:15:38.512702 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b5af4f38-9221-414a-bb0f-f78907536d2b req-742cb395-af21-49ed-9403-1bddb08784ba tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414822 Nov 08 16:15:39.641493 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12f19511-72c1-4d07-85fc-651991220dce req-70716009-5af7-4d50-a5b2-0e2becf2c5af tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:15:39.642991 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-12f19511-72c1-4d07-85fc-651991220dce req-70716009-5af7-4d50-a5b2-0e2becf2c5af tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=116d828b-58e5-4928-bdf2-4f0f7cb4cd56 HTTP/1.1" status: 200 len: 946 time: 0.0580096 Nov 08 16:15:39.691430 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-12f19511-72c1-4d07-85fc-651991220dce req-97db94d5-c956-4ba4-8686-8cdd943cc6c6 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420170 Nov 08 16:15:40.584535 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-e81eac58-3bf7-48ab-8e01-b9f65603c2d3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:41.526355 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:43.254752 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:43.955502 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:15:47.941773 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:08.118695 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-d108c939-03f6-46e6-a637-04550548ca8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:10.584583 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-e329ca8a-42df-4459-9f55-39c7245964c1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:11.529816 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:13.256336 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:13.957959 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:14.603641 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:16:17.940536 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:25.667953 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 38302) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:25.794217 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-1e6f99da-a5ee-4e9f-ab90-7f6ac00048fe admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:25.877278 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a16a805f-720b-4014-ab14-c8a199987218 req-bfee3979-8bc4-4ee6-a5be-8a5b1d62546d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:25.879557 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a16a805f-720b-4014-ab14-c8a199987218 req-bfee3979-8bc4-4ee6-a5be-8a5b1d62546d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0826225 Nov 08 16:16:25.979121 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 38328) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:25.983601 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a16a805f-720b-4014-ab14-c8a199987218 req-265cccb9-dea5-4e69-8d86-51291560689e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0926836 Nov 08 16:16:25.985582 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-1e6f99da-a5ee-4e9f-ab90-7f6ac00048fe admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:25.991578 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-1e6f99da-a5ee-4e9f-ab90-7f6ac00048fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:26.046441 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 38334) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:26.046788 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-1e6f99da-a5ee-4e9f-ab90-7f6ac00048fe admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=ab1626351f5b47d390efb653357f1f6c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3773427 Nov 08 16:16:26.049761 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e6f99da-a5ee-4e9f-ab90-7f6ac00048fe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=42aa350a-f580-4b57-92ce-e0dd128afe65,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:26.060868 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e6f99da-a5ee-4e9f-ab90-7f6ac00048fe admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:26.061360 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e6f99da-a5ee-4e9f-ab90-7f6ac00048fe admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:26.062238 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e6f99da-a5ee-4e9f-ab90-7f6ac00048fe admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:26.062880 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e6f99da-a5ee-4e9f-ab90-7f6ac00048fe admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:26.063768 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e6f99da-a5ee-4e9f-ab90-7f6ac00048fe admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:26.064329 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e6f99da-a5ee-4e9f-ab90-7f6ac00048fe admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:26.064803 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e6f99da-a5ee-4e9f-ab90-7f6ac00048fe admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:26.065234 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e6f99da-a5ee-4e9f-ab90-7f6ac00048fe admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:26.065768 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e6f99da-a5ee-4e9f-ab90-7f6ac00048fe admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:26.066199 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e6f99da-a5ee-4e9f-ab90-7f6ac00048fe admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:26.066684 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e6f99da-a5ee-4e9f-ab90-7f6ac00048fe admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:26.067181 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e6f99da-a5ee-4e9f-ab90-7f6ac00048fe admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:26.122062 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ab1647ef-ea5e-4f57-87c3-abeb008afe4b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:26.155517 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ab1647ef-ea5e-4f57-87c3-abeb008afe4b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:26.172109 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-593e4e8a-5179-46a2-a3c5-8c992a261a40 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:26.214714 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ab1647ef-ea5e-4f57-87c3-abeb008afe4b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:26.220207 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ab1647ef-ea5e-4f57-87c3-abeb008afe4b admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:26.220207 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-ab1647ef-ea5e-4f57-87c3-abeb008afe4b admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/42aa350a-f580-4b57-92ce-e0dd128afe65 HTTP/1.1" status: 204 len: 168 time: 0.1712108 Nov 08 16:16:26.231574 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab1647ef-ea5e-4f57-87c3-abeb008afe4b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=42aa350a-f580-4b57-92ce-e0dd128afe65,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:26.313888 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-593e4e8a-5179-46a2-a3c5-8c992a261a40 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:26.321500 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-593e4e8a-5179-46a2-a3c5-8c992a261a40 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:26.369760 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-593e4e8a-5179-46a2-a3c5-8c992a261a40 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=662460bf5b36411f82bab62bd888c4ab&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3857768 Nov 08 16:16:26.369760 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-593e4e8a-5179-46a2-a3c5-8c992a261a40 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6c1c578b-dd63-4b30-9dd2-beada0dd5ca6,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:26.369760 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 38358) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:26.434446 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7add1d2e-cb64-4a9d-9319-7d7b6dd04de3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:26.482858 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7add1d2e-cb64-4a9d-9319-7d7b6dd04de3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:26.538847 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7add1d2e-cb64-4a9d-9319-7d7b6dd04de3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:26.541916 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7add1d2e-cb64-4a9d-9319-7d7b6dd04de3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:26.543370 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-7add1d2e-cb64-4a9d-9319-7d7b6dd04de3 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/6c1c578b-dd63-4b30-9dd2-beada0dd5ca6 HTTP/1.1" status: 204 len: 168 time: 0.1731427 Nov 08 16:16:26.552487 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7add1d2e-cb64-4a9d-9319-7d7b6dd04de3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6c1c578b-dd63-4b30-9dd2-beada0dd5ca6,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:26.664132 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88a814b0-5b34-4f96-952b-463e40bb3a9a req-222d175e-6381-4d2f-8520-4b178fe9c30e tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:26.666088 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-88a814b0-5b34-4f96-952b-463e40bb3a9a req-222d175e-6381-4d2f-8520-4b178fe9c30e tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=116d828b-58e5-4928-bdf2-4f0f7cb4cd56 HTTP/1.1" status: 200 len: 946 time: 0.0558493 Nov 08 16:16:26.669010 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 38376) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:26.682541 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-df2eb73b-8e3b-46c8-9df9-ea866cf1329f admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:26.739370 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-88a814b0-5b34-4f96-952b-463e40bb3a9a req-7548afb4-8589-45a2-8481-0d666bfb575b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0637140 Nov 08 16:16:26.765464 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 38378) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:26.780665 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-df2eb73b-8e3b-46c8-9df9-ea866cf1329f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:26.784000 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-df2eb73b-8e3b-46c8-9df9-ea866cf1329f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:26.826574 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 38382) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:26.830486 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-df2eb73b-8e3b-46c8-9df9-ea866cf1329f admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=0fdf6294115b416eaf77ee784729d908&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1560309 Nov 08 16:16:26.832322 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df2eb73b-8e3b-46c8-9df9-ea866cf1329f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ce9a2b8a-f214-42d2-bc89-5a997892aedd,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:26.887509 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-933a6087-015a-4c22-91ff-490432c2e70a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:26.911293 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-933a6087-015a-4c22-91ff-490432c2e70a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:26.966475 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-933a6087-015a-4c22-91ff-490432c2e70a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:26.969748 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-933a6087-015a-4c22-91ff-490432c2e70a admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:26.972233 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-933a6087-015a-4c22-91ff-490432c2e70a admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/ce9a2b8a-f214-42d2-bc89-5a997892aedd HTTP/1.1" status: 204 len: 168 time: 0.1437459 Nov 08 16:16:26.985018 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-933a6087-015a-4c22-91ff-490432c2e70a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ce9a2b8a-f214-42d2-bc89-5a997892aedd,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:27.024543 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0d119174-1e79-43a1-8a8e-9f59bb94ea3e admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:27.134468 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0d119174-1e79-43a1-8a8e-9f59bb94ea3e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:27.147066 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b6c57c4-e14a-406f-a679-c473b59b2f2d req-32e6a2c9-b883-4dd7-8aa5-639569d186b1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:27.148559 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1b6c57c4-e14a-406f-a679-c473b59b2f2d req-32e6a2c9-b883-4dd7-8aa5-639569d186b1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0751119 Nov 08 16:16:27.149556 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0d119174-1e79-43a1-8a8e-9f59bb94ea3e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:27.205022 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d119174-1e79-43a1-8a8e-9f59bb94ea3e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=681de3ba-2ccd-4a05-969d-a1432f8f708e,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:27.214492 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-0d119174-1e79-43a1-8a8e-9f59bb94ea3e admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=07e0ccdaa3ca4256a610c8420226496b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4479096 Nov 08 16:16:27.217306 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 38390) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:27.240225 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1b6c57c4-e14a-406f-a679-c473b59b2f2d req-e1326737-f8a5-4362-942d-8776dc2ecf74 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0746453 Nov 08 16:16:27.277840 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bbd45c4d-cdca-45ac-a6e3-b52a784c5eab admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:27.298152 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bbd45c4d-cdca-45ac-a6e3-b52a784c5eab admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:27.344223 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bbd45c4d-cdca-45ac-a6e3-b52a784c5eab admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:27.347020 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bbd45c4d-cdca-45ac-a6e3-b52a784c5eab admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:27.350714 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-bbd45c4d-cdca-45ac-a6e3-b52a784c5eab admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/681de3ba-2ccd-4a05-969d-a1432f8f708e HTTP/1.1" status: 204 len: 168 time: 0.1298923 Nov 08 16:16:27.355997 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbd45c4d-cdca-45ac-a6e3-b52a784c5eab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=681de3ba-2ccd-4a05-969d-a1432f8f708e,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:27.668014 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 38414) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:27.681172 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-aa01b438-4154-453a-ad49-f195da45733f admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:27.761221 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-aa01b438-4154-453a-ad49-f195da45733f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:27.774493 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-aa01b438-4154-453a-ad49-f195da45733f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:27.818166 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-aa01b438-4154-453a-ad49-f195da45733f admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=fc2e8cc66d3e4054bb9ee7124722e6c5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1488891 Nov 08 16:16:27.819170 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa01b438-4154-453a-ad49-f195da45733f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=31e09391-1801-4314-957b-3cf72dad2c1b,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:27.820866 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 38420) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:27.937481 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7ca3dfbe-baf9-4762-a1a4-05b86848db04 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:27.946713 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fae1770-79fc-4978-85ef-16be2b378f47 req-637140a4-d7f0-45e1-aabf-06c87b7f0bf1 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:27.954620 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9fae1770-79fc-4978-85ef-16be2b378f47 req-637140a4-d7f0-45e1-aabf-06c87b7f0bf1 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=116d828b-58e5-4928-bdf2-4f0f7cb4cd56 HTTP/1.1" status: 200 len: 946 time: 0.1131437 Nov 08 16:16:27.994527 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7ca3dfbe-baf9-4762-a1a4-05b86848db04 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:28.030854 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9fae1770-79fc-4978-85ef-16be2b378f47 req-97245351-f58c-4c5e-8972-c72c811f555b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0752084 Nov 08 16:16:28.071044 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7ca3dfbe-baf9-4762-a1a4-05b86848db04 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:28.073851 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7ca3dfbe-baf9-4762-a1a4-05b86848db04 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:28.074979 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-7ca3dfbe-baf9-4762-a1a4-05b86848db04 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/31e09391-1801-4314-957b-3cf72dad2c1b HTTP/1.1" status: 204 len: 168 time: 0.2487133 Nov 08 16:16:28.082978 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ca3dfbe-baf9-4762-a1a4-05b86848db04 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=31e09391-1801-4314-957b-3cf72dad2c1b,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:28.362098 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b49dad7-59df-40b8-af96-ea31b086c154 req-6a098982-fbfd-410c-a34f-756d17790725 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:28.363832 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2b49dad7-59df-40b8-af96-ea31b086c154 req-6a098982-fbfd-410c-a34f-756d17790725 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0494874 Nov 08 16:16:28.415915 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2b49dad7-59df-40b8-af96-ea31b086c154 req-7a75a161-1f4a-4b25-b288-d79f6ace968c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457983 Nov 08 16:16:29.015679 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef373cd0-4c31-4d40-b7a6-173208bcbca0 req-5f354f33-85ce-44d5-b617-c2c3d2a4caa9 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:29.015679 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ef373cd0-4c31-4d40-b7a6-173208bcbca0 req-5f354f33-85ce-44d5-b617-c2c3d2a4caa9 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.25 "GET /v2.0/ports?device_id=116d828b-58e5-4928-bdf2-4f0f7cb4cd56 HTTP/1.1" status: 200 len: 946 time: 0.0585999 Nov 08 16:16:29.137776 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-ef373cd0-4c31-4d40-b7a6-173208bcbca0 req-cd0762e9-d182-4946-8b0a-bf40fdbfd38b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Deleting port f510df50-3aa6-4a56-a3f6-1075cc078430 {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:16:29.138114 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-ef373cd0-4c31-4d40-b7a6-173208bcbca0 req-cd0762e9-d182-4946-8b0a-bf40fdbfd38b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:29.237534 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2abf88f1-3cd3-43e9-b02e-47104d7f7712 req-34aa86f7-f760-4d24-8dfe-8248b98589d0 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:29.239063 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2abf88f1-3cd3-43e9-b02e-47104d7f7712 req-34aa86f7-f760-4d24-8dfe-8248b98589d0 tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/ports?device_id=116d828b-58e5-4928-bdf2-4f0f7cb4cd56 HTTP/1.1" status: 200 len: 946 time: 0.1170967 Nov 08 16:16:29.278183 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-ef373cd0-4c31-4d40-b7a6-173208bcbca0 req-cd0762e9-d182-4946-8b0a-bf40fdbfd38b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] For port f510df50-3aa6-4a56-a3f6-1075cc078430, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=f510df50-3aa6-4a56-a3f6-1075cc078430,segment=NetworkSegment(d89c6b3f-ecc6-4296-92e8-9f4a30c70af3),segment_id=d89c6b3f-ecc6-4296-92e8-9f4a30c70af3)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:16:29.278782 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-ef373cd0-4c31-4d40-b7a6-173208bcbca0 req-cd0762e9-d182-4946-8b0a-bf40fdbfd38b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:29.296691 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-ef373cd0-4c31-4d40-b7a6-173208bcbca0 req-cd0762e9-d182-4946-8b0a-bf40fdbfd38b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Calling delete_port for f510df50-3aa6-4a56-a3f6-1075cc078430 owned by compute:nova {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:16:29.329994 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2abf88f1-3cd3-43e9-b02e-47104d7f7712 req-669be38e-909b-42e9-8d07-464ba055418c tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.37 "GET /v2.0/security-groups?id=5158333e-8a1f-4579-b040-8c9e867322b3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0847168 Nov 08 16:16:29.481959 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-ef373cd0-4c31-4d40-b7a6-173208bcbca0 req-cd0762e9-d182-4946-8b0a-bf40fdbfd38b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:29.496252 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['f510df50-3aa6-4a56-a3f6-1075cc078430'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:16:29.514599 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd0762e9-d182-4946-8b0a-bf40fdbfd38b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Pushing event deleted for resources: {'Port': ['ID=f510df50-3aa6-4a56-a3f6-1075cc078430,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:29.594744 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-ef373cd0-4c31-4d40-b7a6-173208bcbca0 req-cd0762e9-d182-4946-8b0a-bf40fdbfd38b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] No DVR routers for this DVR port f510df50-3aa6-4a56-a3f6-1075cc078430 on host hv-cinder-81618 {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:16:29.598229 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-ef373cd0-4c31-4d40-b7a6-173208bcbca0 req-cd0762e9-d182-4946-8b0a-bf40fdbfd38b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:29.601457 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ef373cd0-4c31-4d40-b7a6-173208bcbca0 req-cd0762e9-d182-4946-8b0a-bf40fdbfd38b tempest-VolumesSnapshotTestJSON-1976408321 tempest-VolumesSnapshotTestJSON-1976408321-project] 10.222.0.25 "DELETE /v2.0/ports/f510df50-3aa6-4a56-a3f6-1075cc078430 HTTP/1.1" status: 204 len: 173 time: 0.5811572 Nov 08 16:16:29.603488 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '116d828b-58e5-4928-bdf2-4f0f7cb4cd56', 'name': 'network-vif-deleted', 'tag': 'f510df50-3aa6-4a56-a3f6-1075cc078430'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:16:29.605944 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-06786af6-39bb-4476-9d24-d6aed5277f42" -d '{"events": [{"server_uuid": "116d828b-58e5-4928-bdf2-4f0f7cb4cd56", "name": "network-vif-deleted", "tag": "f510df50-3aa6-4a56-a3f6-1075cc078430"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:16:29.619190 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbba94a6-990a-4712-8cbe-2f714f86d4b9 req-0fa8a8ba-e42e-4abe-a218-a9e9f4ec7e68 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:29.626300 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fbba94a6-990a-4712-8cbe-2f714f86d4b9 req-0fa8a8ba-e42e-4abe-a218-a9e9f4ec7e68 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.1132469 Nov 08 16:16:29.662694 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:16:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2453c89a-e7d3-464a-acd1-eec5a53a357f x-openstack-request-id: req-2453c89a-e7d3-464a-acd1-eec5a53a357f {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:16:29.662998 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "116d828b-58e5-4928-bdf2-4f0f7cb4cd56", "name": "network-vif-deleted", "tag": "f510df50-3aa6-4a56-a3f6-1075cc078430", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:16:29.663225 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-2453c89a-e7d3-464a-acd1-eec5a53a357f {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:16:29.663612 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '116d828b-58e5-4928-bdf2-4f0f7cb4cd56', 'name': 'network-vif-deleted', 'tag': 'f510df50-3aa6-4a56-a3f6-1075cc078430', 'status': 'completed', 'code': 200} Nov 08 16:16:29.687639 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fbba94a6-990a-4712-8cbe-2f714f86d4b9 req-0edcb6ac-3a34-4c09-aab9-b8eabfb1b23e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0604150 Nov 08 16:16:30.806173 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df68f0af-e7aa-4952-8258-42d4502bd4ea req-a8765dd7-96a1-484d-88aa-781d4c03b52f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:30.807642 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-df68f0af-e7aa-4952-8258-42d4502bd4ea req-a8765dd7-96a1-484d-88aa-781d4c03b52f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0484259 Nov 08 16:16:30.853217 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-df68f0af-e7aa-4952-8258-42d4502bd4ea req-e5270eb4-69c6-460a-8794-866d50129ded tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398397 Nov 08 16:16:31.971096 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-782f97b1-f8f1-412c-b0bc-007e4b1effd6 req-83c466a1-11bb-4ac9-99ff-4c286c8052ed tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:31.972566 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-782f97b1-f8f1-412c-b0bc-007e4b1effd6 req-83c466a1-11bb-4ac9-99ff-4c286c8052ed tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0474508 Nov 08 16:16:32.021313 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-782f97b1-f8f1-412c-b0bc-007e4b1effd6 req-11d011ba-0217-4a99-ba25-c7f26044ca6d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427597 Nov 08 16:16:33.086758 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 38626) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:33.138844 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-950f2057-ea5d-46f0-8f15-da44621a7cea req-7adfaff7-0b9a-4017-87d5-d530e49267ca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:33.140218 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-950f2057-ea5d-46f0-8f15-da44621a7cea req-7adfaff7-0b9a-4017-87d5-d530e49267ca tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0476587 Nov 08 16:16:33.196781 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-950f2057-ea5d-46f0-8f15-da44621a7cea req-77f3f34a-42d0-47f6-98c0-43979bda72ba tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0502493 Nov 08 16:16:33.197900 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d6e716ed-0d85-4838-bff6-086401a716d2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:33.272071 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d6e716ed-0d85-4838-bff6-086401a716d2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:33.275642 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d6e716ed-0d85-4838-bff6-086401a716d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:33.312079 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-d6e716ed-0d85-4838-bff6-086401a716d2 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=d7f76ab857294e81a177a8cefa6ae338&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2242429 Nov 08 16:16:33.313156 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6e716ed-0d85-4838-bff6-086401a716d2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2bdb8450-d34b-496f-bbf8-37193c0fe5b4,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:33.314837 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 38630) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:33.363822 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9adcdd04-5bf9-40c4-b423-a31ce6795846 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:33.385474 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9adcdd04-5bf9-40c4-b423-a31ce6795846 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:33.432495 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9adcdd04-5bf9-40c4-b423-a31ce6795846 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:33.435292 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9adcdd04-5bf9-40c4-b423-a31ce6795846 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:33.436422 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-9adcdd04-5bf9-40c4-b423-a31ce6795846 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/2bdb8450-d34b-496f-bbf8-37193c0fe5b4 HTTP/1.1" status: 204 len: 168 time: 0.1191628 Nov 08 16:16:33.444562 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9adcdd04-5bf9-40c4-b423-a31ce6795846 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2bdb8450-d34b-496f-bbf8-37193c0fe5b4,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:33.451450 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9adcdd04-5bf9-40c4-b423-a31ce6795846 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:33.451801 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9adcdd04-5bf9-40c4-b423-a31ce6795846 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:33.452136 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9adcdd04-5bf9-40c4-b423-a31ce6795846 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:33.452465 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9adcdd04-5bf9-40c4-b423-a31ce6795846 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:33.452785 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9adcdd04-5bf9-40c4-b423-a31ce6795846 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:33.453105 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9adcdd04-5bf9-40c4-b423-a31ce6795846 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:33.453425 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9adcdd04-5bf9-40c4-b423-a31ce6795846 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:33.453770 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9adcdd04-5bf9-40c4-b423-a31ce6795846 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:33.454188 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9adcdd04-5bf9-40c4-b423-a31ce6795846 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:33.454391 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9adcdd04-5bf9-40c4-b423-a31ce6795846 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:33.454703 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9adcdd04-5bf9-40c4-b423-a31ce6795846 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:33.455015 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9adcdd04-5bf9-40c4-b423-a31ce6795846 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:33.685472 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 38638) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:33.698574 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e5105f42-80d7-4846-a63f-0db7c242455b admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:33.768755 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e5105f42-80d7-4846-a63f-0db7c242455b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:33.772383 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e5105f42-80d7-4846-a63f-0db7c242455b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:33.808403 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-e5105f42-80d7-4846-a63f-0db7c242455b admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=5cd094962a0b4ff5bc5163f3c2ab9796&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1219032 Nov 08 16:16:33.809202 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5105f42-80d7-4846-a63f-0db7c242455b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=347a9119-3fc0-4ffb-bba2-c7d4cb4dbf24,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:33.811903 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 38640) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:33.859868 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device f510df50-3aa6-4a56-a3f6-1075cc078430 no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:16:33.865144 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b4d7ad6e-77f1-4f7f-87d9-25b4fb56845a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:33.880840 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] No Port match for: f510df50-3aa6-4a56-a3f6-1075cc078430 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:16:33.881175 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device f510df50-3aa6-4a56-a3f6-1075cc078430 not bound to the agent host hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:16:33.886871 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b4d7ad6e-77f1-4f7f-87d9-25b4fb56845a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:33.935468 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b4d7ad6e-77f1-4f7f-87d9-25b4fb56845a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:33.938362 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b4d7ad6e-77f1-4f7f-87d9-25b4fb56845a admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:33.939525 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-b4d7ad6e-77f1-4f7f-87d9-25b4fb56845a admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/347a9119-3fc0-4ffb-bba2-c7d4cb4dbf24 HTTP/1.1" status: 204 len: 168 time: 0.1262136 Nov 08 16:16:33.946760 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4d7ad6e-77f1-4f7f-87d9-25b4fb56845a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=347a9119-3fc0-4ffb-bba2-c7d4cb4dbf24,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:34.318494 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33ea893c-8d4a-477d-be08-c3247513295b req-33d5cb26-1039-44fd-a3a8-a9d808551319 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:34.319983 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-33ea893c-8d4a-477d-be08-c3247513295b req-33d5cb26-1039-44fd-a3a8-a9d808551319 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0499742 Nov 08 16:16:34.367266 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-33ea893c-8d4a-477d-be08-c3247513295b req-76108bdb-6e1f-40e0-82ac-3320c4392742 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415037 Nov 08 16:16:35.484467 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39f46e8e-7c1c-44b1-8d37-972967610801 req-d3254e1d-a365-4110-b3fc-1a22775886be tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:35.485950 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-39f46e8e-7c1c-44b1-8d37-972967610801 req-d3254e1d-a365-4110-b3fc-1a22775886be tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0477874 Nov 08 16:16:35.537012 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-39f46e8e-7c1c-44b1-8d37-972967610801 req-87418dc8-a90b-4a47-98e2-dbfae574fbee tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450921 Nov 08 16:16:36.651715 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bf06c88-6752-497b-b5bd-e5313c38988a req-0efa97f7-5d6e-406d-bd5d-9a0f35ff5a78 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:36.653149 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7bf06c88-6752-497b-b5bd-e5313c38988a req-0efa97f7-5d6e-406d-bd5d-9a0f35ff5a78 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0474331 Nov 08 16:16:36.698430 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7bf06c88-6752-497b-b5bd-e5313c38988a req-68b0cee1-b82e-4208-9369-4b8c9cf4b734 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394928 Nov 08 16:16:37.813857 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e897d78-cec0-43fd-aea3-636394bfd158 req-77745652-9ea9-4397-9f7a-9201378a7812 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:37.815334 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6e897d78-cec0-43fd-aea3-636394bfd158 req-77745652-9ea9-4397-9f7a-9201378a7812 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0476954 Nov 08 16:16:37.860923 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6e897d78-cec0-43fd-aea3-636394bfd158 req-04cc096f-1403-460b-bcff-21cc7348cec8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398347 Nov 08 16:16:38.121981 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-1b07f2f3-c5ce-4bbe-b8ed-c249cf7175a7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:38.980151 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ef0905f-b177-4954-aa68-cba4c6af124a req-5bc06bf2-d3e7-433c-8103-df6956fc94e0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:38.981577 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0ef0905f-b177-4954-aa68-cba4c6af124a req-5bc06bf2-d3e7-433c-8103-df6956fc94e0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0508971 Nov 08 16:16:39.028037 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0ef0905f-b177-4954-aa68-cba4c6af124a req-cebcc6b0-9826-4752-bda7-130a6bf7de2c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400999 Nov 08 16:16:40.158503 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afc3cac6-ec46-4da8-b7c5-c2c5b33a41d6 req-0c5824af-0753-4bdb-ba42-d2434753cd3d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:40.160074 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-afc3cac6-ec46-4da8-b7c5-c2c5b33a41d6 req-0c5824af-0753-4bdb-ba42-d2434753cd3d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0584538 Nov 08 16:16:40.228802 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-824f9531-e35d-433c-8962-309b34fa1adc req-bd89eb44-face-44e2-a346-8ad66664242e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:40.230297 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-824f9531-e35d-433c-8962-309b34fa1adc req-bd89eb44-face-44e2-a346-8ad66664242e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0889251 Nov 08 16:16:40.238141 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-afc3cac6-ec46-4da8-b7c5-c2c5b33a41d6 req-1183ca51-6cfc-4593-a007-4ccfa7c9fd4d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0650468 Nov 08 16:16:40.285627 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-824f9531-e35d-433c-8962-309b34fa1adc req-588e9299-5143-4ce6-9604-20a83a550149 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463858 Nov 08 16:16:40.584744 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-dadc6610-7f75-4534-ab3b-cfb39ac0fbb3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:41.358043 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-581cdf15-0e9d-4f33-a4ae-d9354fde5e59 req-b3ad4f77-98b5-4eae-bc75-cf2866bddec5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:41.359431 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-581cdf15-0e9d-4f33-a4ae-d9354fde5e59 req-b3ad4f77-98b5-4eae-bc75-cf2866bddec5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0500073 Nov 08 16:16:41.444066 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-581cdf15-0e9d-4f33-a4ae-d9354fde5e59 req-975e004d-d2dd-41b1-a5db-35b05a2da7c8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0734274 Nov 08 16:16:41.457053 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b250e367-1159-45cf-83a8-18b140070d46 req-201591ad-9e55-4ed1-8986-86ebe33f1920 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:41.465261 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b250e367-1159-45cf-83a8-18b140070d46 req-201591ad-9e55-4ed1-8986-86ebe33f1920 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.1048286 Nov 08 16:16:41.528025 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b250e367-1159-45cf-83a8-18b140070d46 req-a5432aa0-28b4-4558-becc-65a789a3320a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0617299 Nov 08 16:16:41.536723 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:42.573410 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9834021-36e3-4c70-b7d8-f2b55df3d035 req-ed8f1e20-4689-4dd1-9521-9ba538575b1a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:42.574932 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c9834021-36e3-4c70-b7d8-f2b55df3d035 req-ed8f1e20-4689-4dd1-9521-9ba538575b1a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0492234 Nov 08 16:16:42.647680 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c9834021-36e3-4c70-b7d8-f2b55df3d035 req-d1425c0d-cfda-4815-99de-c9a931c3c38b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0669711 Nov 08 16:16:42.663386 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e39e05b-01c2-4e08-979b-7069b1e38327 req-861774a6-be28-4e00-9893-847c74cb3924 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:42.664860 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8e39e05b-01c2-4e08-979b-7069b1e38327 req-861774a6-be28-4e00-9893-847c74cb3924 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0592461 Nov 08 16:16:42.715087 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8e39e05b-01c2-4e08-979b-7069b1e38327 req-4bba3424-0e4a-442c-b338-c12bb15a72cf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445099 Nov 08 16:16:43.269881 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:43.773851 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c54d0b3-09d6-4303-a701-cef99fbc39ee req-884792ce-4488-4f01-abb8-eea91b537291 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:43.775774 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1c54d0b3-09d6-4303-a701-cef99fbc39ee req-884792ce-4488-4f01-abb8-eea91b537291 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0571434 Nov 08 16:16:43.859016 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1c54d0b3-09d6-4303-a701-cef99fbc39ee req-66131fe8-f2df-44de-8e8a-5f139a71056a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0757544 Nov 08 16:16:43.867600 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92609bca-8059-4684-8644-b7e15c0b725a req-2a1bcd22-6802-4b7c-baf4-9408c36099aa tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:43.868997 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-92609bca-8059-4684-8644-b7e15c0b725a req-2a1bcd22-6802-4b7c-baf4-9408c36099aa tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0776982 Nov 08 16:16:43.925524 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-92609bca-8059-4684-8644-b7e15c0b725a req-6430ef66-f467-4d48-878f-9c3be5727331 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0468960 Nov 08 16:16:43.964401 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:44.461023 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 38922) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:44.561618 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-54bc8b09-cb59-4eb2-8f6b-d38108203b6e admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:44.635694 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-54bc8b09-cb59-4eb2-8f6b-d38108203b6e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:44.639250 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-54bc8b09-cb59-4eb2-8f6b-d38108203b6e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:44.676773 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-54bc8b09-cb59-4eb2-8f6b-d38108203b6e admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=9a3b8c1f0efa42aab0f4743cf1641c05&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2147126 Nov 08 16:16:44.677703 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54bc8b09-cb59-4eb2-8f6b-d38108203b6e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6524aa25-527b-47f4-af0a-40ffcdd2e136,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:44.679410 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 38926) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:44.725603 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1dd170e0-adb0-446d-b6ec-69f9875839b2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:44.745465 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1dd170e0-adb0-446d-b6ec-69f9875839b2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:44.790047 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1dd170e0-adb0-446d-b6ec-69f9875839b2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:44.792609 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1dd170e0-adb0-446d-b6ec-69f9875839b2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:44.793735 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-1dd170e0-adb0-446d-b6ec-69f9875839b2 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/6524aa25-527b-47f4-af0a-40ffcdd2e136 HTTP/1.1" status: 204 len: 168 time: 0.1133511 Nov 08 16:16:44.801105 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dd170e0-adb0-446d-b6ec-69f9875839b2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6524aa25-527b-47f4-af0a-40ffcdd2e136,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:44.986609 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcb80a10-5e2e-4d5c-b922-2bdba68bd01b req-4da4a838-7804-4bde-86af-d05a8c6bd996 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:44.988274 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bcb80a10-5e2e-4d5c-b922-2bdba68bd01b req-4da4a838-7804-4bde-86af-d05a8c6bd996 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0558765 Nov 08 16:16:45.061234 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 38940) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:45.073576 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bcb80a10-5e2e-4d5c-b922-2bdba68bd01b req-359fa57a-7636-4ee7-ad49-ef72d4afccfb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0789776 Nov 08 16:16:45.077848 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-514865e9-26a3-433c-aa30-b41c69377f31 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:45.082809 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-420b1a8c-ce21-4075-8dff-b5277bd34dde req-e12af30a-2279-4151-b595-a46323b0507a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:45.084336 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-420b1a8c-ce21-4075-8dff-b5277bd34dde req-e12af30a-2279-4151-b595-a46323b0507a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0802178 Nov 08 16:16:45.166474 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-514865e9-26a3-433c-aa30-b41c69377f31 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:45.166781 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-420b1a8c-ce21-4075-8dff-b5277bd34dde req-3d0fc7d0-ce1c-4ec2-a86b-ca5c5f58f6fe tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0728893 Nov 08 16:16:45.171525 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-514865e9-26a3-433c-aa30-b41c69377f31 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:45.208918 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-514865e9-26a3-433c-aa30-b41c69377f31 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eee1cd1d-ae19-447e-9dea-ca9353389e0a,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:45.215520 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-514865e9-26a3-433c-aa30-b41c69377f31 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=4dd15497934e40b5b173421080d43e4a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1507196 Nov 08 16:16:45.215933 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 38946) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:45.265382 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d89ffb49-f3f3-400b-a4e1-985266491be6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:45.286643 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d89ffb49-f3f3-400b-a4e1-985266491be6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:45.335909 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d89ffb49-f3f3-400b-a4e1-985266491be6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:45.338585 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d89ffb49-f3f3-400b-a4e1-985266491be6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:45.339796 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-d89ffb49-f3f3-400b-a4e1-985266491be6 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/eee1cd1d-ae19-447e-9dea-ca9353389e0a HTTP/1.1" status: 204 len: 168 time: 0.1229372 Nov 08 16:16:45.348758 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d89ffb49-f3f3-400b-a4e1-985266491be6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eee1cd1d-ae19-447e-9dea-ca9353389e0a,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:45.692461 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 38968) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:45.839568 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7c9f7b28-cd50-4847-bac4-34831b6e4629 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:45.915109 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7c9f7b28-cd50-4847-bac4-34831b6e4629 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:45.919059 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7c9f7b28-cd50-4847-bac4-34831b6e4629 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:45.957614 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-7c9f7b28-cd50-4847-bac4-34831b6e4629 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=fcc2ef809aa747e0a7a9538dbafebec0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2640316 Nov 08 16:16:45.958511 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c9f7b28-cd50-4847-bac4-34831b6e4629 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=370784b6-1f61-4e7d-8af1-08f2820f819d,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:45.960311 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 38982) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:46.009303 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e46e1fbd-5b97-4d8c-bbb0-9fcabe81b21a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:46.030045 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e46e1fbd-5b97-4d8c-bbb0-9fcabe81b21a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:46.074404 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e46e1fbd-5b97-4d8c-bbb0-9fcabe81b21a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:46.077190 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e46e1fbd-5b97-4d8c-bbb0-9fcabe81b21a admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:46.081216 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-e46e1fbd-5b97-4d8c-bbb0-9fcabe81b21a admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/370784b6-1f61-4e7d-8af1-08f2820f819d HTTP/1.1" status: 204 len: 168 time: 0.1160934 Nov 08 16:16:46.089238 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e46e1fbd-5b97-4d8c-bbb0-9fcabe81b21a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=370784b6-1f61-4e7d-8af1-08f2820f819d,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:46.222166 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757d014b-fb31-420d-aa4f-ddac68b456f9 req-7cec83b5-fcf5-4cec-9938-f73892071fd8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:46.229384 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-757d014b-fb31-420d-aa4f-ddac68b456f9 req-7cec83b5-fcf5-4cec-9938-f73892071fd8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0606682 Nov 08 16:16:46.303295 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-757d014b-fb31-420d-aa4f-ddac68b456f9 req-f7875e9e-8f80-4b60-9de5-9c51f5fa839f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0730050 Nov 08 16:16:46.331884 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64357632-4615-49d5-9dc3-291afca24ac9 req-dc526476-5c09-4a56-a425-26c9205bd82e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:46.333451 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-64357632-4615-49d5-9dc3-291afca24ac9 req-dc526476-5c09-4a56-a425-26c9205bd82e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0820994 Nov 08 16:16:46.383729 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-64357632-4615-49d5-9dc3-291afca24ac9 req-936fe791-50b0-478f-9ee2-9664580a5473 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438135 Nov 08 16:16:46.393077 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 39002) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:46.406473 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-da065614-e13e-4c7c-ae35-a858eb4e38c7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:46.482381 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-da065614-e13e-4c7c-ae35-a858eb4e38c7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:46.486030 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-da065614-e13e-4c7c-ae35-a858eb4e38c7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:46.524461 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-da065614-e13e-4c7c-ae35-a858eb4e38c7 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=7e6a31c1229a43b6b9220975f00f004d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1301420 Nov 08 16:16:46.525339 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da065614-e13e-4c7c-ae35-a858eb4e38c7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dc613c7c-4a23-4292-bc54-fd3220587b62,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:46.527273 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 39006) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:46.581464 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0dcc2e05-e260-4c37-a74a-bddcddd86474 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:46.607748 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0dcc2e05-e260-4c37-a74a-bddcddd86474 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:46.657867 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0dcc2e05-e260-4c37-a74a-bddcddd86474 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:46.660856 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0dcc2e05-e260-4c37-a74a-bddcddd86474 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:46.664531 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-0dcc2e05-e260-4c37-a74a-bddcddd86474 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/dc613c7c-4a23-4292-bc54-fd3220587b62 HTTP/1.1" status: 204 len: 168 time: 0.1336100 Nov 08 16:16:46.669279 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dcc2e05-e260-4c37-a74a-bddcddd86474 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dc613c7c-4a23-4292-bc54-fd3220587b62,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:46.930868 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 39020) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:46.944404 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-745e96cf-a671-4031-aeb9-e353d584cf43 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:47.016307 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-745e96cf-a671-4031-aeb9-e353d584cf43 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:47.021284 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-745e96cf-a671-4031-aeb9-e353d584cf43 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:47.058548 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-745e96cf-a671-4031-aeb9-e353d584cf43 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=88408735810049fe8c245d3d363edf70&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1266351 Nov 08 16:16:47.059626 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-745e96cf-a671-4031-aeb9-e353d584cf43 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=096d8dab-d36c-4385-9ff0-cc4ccb655f09,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:47.061283 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 39026) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:47.120171 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-2e210348-0bb9-432c-bf15-c5c0806343c5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:47.140879 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-2e210348-0bb9-432c-bf15-c5c0806343c5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:47.191302 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-2e210348-0bb9-432c-bf15-c5c0806343c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:47.194172 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-2e210348-0bb9-432c-bf15-c5c0806343c5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:47.195348 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-2e210348-0bb9-432c-bf15-c5c0806343c5 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/096d8dab-d36c-4385-9ff0-cc4ccb655f09 HTTP/1.1" status: 204 len: 168 time: 0.1325328 Nov 08 16:16:47.203836 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e210348-0bb9-432c-bf15-c5c0806343c5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=096d8dab-d36c-4385-9ff0-cc4ccb655f09,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:47.443695 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a1cb49-1f7f-4fbf-8dd7-6b6948851fe6 req-8a6e315f-15ee-44b1-83ba-0f9a74eabcc7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:47.445391 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b1a1cb49-1f7f-4fbf-8dd7-6b6948851fe6 req-8a6e315f-15ee-44b1-83ba-0f9a74eabcc7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0553291 Nov 08 16:16:47.533827 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b1a1cb49-1f7f-4fbf-8dd7-6b6948851fe6 req-3c43cdbe-dd14-4a4c-81eb-3c8b6975391b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0825043 Nov 08 16:16:47.542289 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73a660d3-e777-4db1-adb9-365a18a0af57 req-aa5ace61-fcb2-4343-ab4f-8d6a4804d43d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:47.543602 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-73a660d3-e777-4db1-adb9-365a18a0af57 req-aa5ace61-fcb2-4343-ab4f-8d6a4804d43d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0785408 Nov 08 16:16:47.595198 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-73a660d3-e777-4db1-adb9-365a18a0af57 req-7988c6a8-683d-43cb-860f-1b2b35a75632 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444186 Nov 08 16:16:47.941341 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:48.261363 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 39068) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:48.360175 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7dbcc315-d22d-428e-8428-59fa1788f131 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:48.434062 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7dbcc315-d22d-428e-8428-59fa1788f131 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:48.437772 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7dbcc315-d22d-428e-8428-59fa1788f131 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:48.476470 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-7dbcc315-d22d-428e-8428-59fa1788f131 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=03f94313b0b34846a40d1e412b0f1fee&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2140594 Nov 08 16:16:48.477574 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dbcc315-d22d-428e-8428-59fa1788f131 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=62e25173-e7e6-47ee-96f7-460bd3bba49d,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:48.479264 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 39074) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:48.525112 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-cd6082c7-091f-49bd-ac14-20fd870f0da3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:48.545337 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-cd6082c7-091f-49bd-ac14-20fd870f0da3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:48.590374 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-cd6082c7-091f-49bd-ac14-20fd870f0da3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:48.592984 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-cd6082c7-091f-49bd-ac14-20fd870f0da3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:48.594192 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-cd6082c7-091f-49bd-ac14-20fd870f0da3 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/62e25173-e7e6-47ee-96f7-460bd3bba49d HTTP/1.1" status: 204 len: 168 time: 0.1139324 Nov 08 16:16:48.602893 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd6082c7-091f-49bd-ac14-20fd870f0da3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=62e25173-e7e6-47ee-96f7-460bd3bba49d,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:48.673280 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11856f7a-3976-44ff-a0c9-6caf689667a8 req-acc362d1-c2af-45a8-9819-25248ac75113 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:48.674792 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-11856f7a-3976-44ff-a0c9-6caf689667a8 req-acc362d1-c2af-45a8-9819-25248ac75113 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0593259 Nov 08 16:16:48.743446 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-11856f7a-3976-44ff-a0c9-6caf689667a8 req-42a7d70c-40c0-45e6-bf30-2a1009dae6bf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0596755 Nov 08 16:16:48.755693 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53b9884b-eebe-4abf-9ccf-a88d26d9a704 req-8ec12d5d-6b30-457d-888f-9989c18b30e8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:48.757149 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-53b9884b-eebe-4abf-9ccf-a88d26d9a704 req-8ec12d5d-6b30-457d-888f-9989c18b30e8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0815094 Nov 08 16:16:48.814443 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-53b9884b-eebe-4abf-9ccf-a88d26d9a704 req-c73da2da-a5fc-4acc-aa1e-4263607d585a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409389 Nov 08 16:16:49.860865 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caa2f2ee-184a-4213-ba31-443f8d1f024b req-470288a3-1357-4f31-aa5b-57840a5cd7b9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:49.862357 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-caa2f2ee-184a-4213-ba31-443f8d1f024b req-470288a3-1357-4f31-aa5b-57840a5cd7b9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0477316 Nov 08 16:16:49.940322 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-caa2f2ee-184a-4213-ba31-443f8d1f024b req-c210393d-bb09-4cb6-af9c-bce28b5a922a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0722103 Nov 08 16:16:49.952136 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dd20327-5d01-4e68-9fd3-3c2701c35012 req-1d0f2a3e-b154-4201-a13b-52930d7befa7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:49.953537 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4dd20327-5d01-4e68-9fd3-3c2701c35012 req-1d0f2a3e-b154-4201-a13b-52930d7befa7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0709126 Nov 08 16:16:50.000410 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4dd20327-5d01-4e68-9fd3-3c2701c35012 req-e29c077a-09f4-4cc2-a5d9-d3c3196b90bb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400782 Nov 08 16:16:51.092855 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-760592b7-faf7-4ee2-9877-f757db139ea2 req-aa16d948-6bfb-4a26-ba41-eb7aeecb0cc5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:51.092855 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-760592b7-faf7-4ee2-9877-f757db139ea2 req-aa16d948-6bfb-4a26-ba41-eb7aeecb0cc5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0548840 Nov 08 16:16:51.168212 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd82ec11-0f9f-4087-9eee-23f68acf4a64 req-b2979154-58a7-43f5-9ca6-9e3c72ec5577 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:51.169661 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cd82ec11-0f9f-4087-9eee-23f68acf4a64 req-b2979154-58a7-43f5-9ca6-9e3c72ec5577 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0801678 Nov 08 16:16:51.173322 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-760592b7-faf7-4ee2-9877-f757db139ea2 req-5386d624-43f5-497a-88bb-6b7039e44ee0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0754688 Nov 08 16:16:51.226520 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cd82ec11-0f9f-4087-9eee-23f68acf4a64 req-9579a390-91e7-452b-8f4d-2bcc9644d757 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0500450 Nov 08 16:16:51.532211 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device fbefda08-fc7a-42a0-b714-6dea3d8a5161 details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:16:51.603497 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:16:51.624790 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port fbefda08-fc7a-42a0-b714-6dea3d8a5161, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=fbefda08-fc7a-42a0-b714-6dea3d8a5161,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:16:51.636320 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': 'fbefda08-fc7a-42a0-b714-6dea3d8a5161', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'port_id': 'fbefda08-fc7a-42a0-b714-6dea3d8a5161', 'mac_address': 'fa:16:3e:13:3c:f6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 188, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:16:51.676713 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:51.808131 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id fbefda08-fc7a-42a0-b714-6dea3d8a5161 {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:16:51.826632 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port fbefda08-fc7a-42a0-b714-6dea3d8a5161, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=fbefda08-fc7a-42a0-b714-6dea3d8a5161,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:16:51.830012 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:51.878374 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=fbefda08-fc7a-42a0-b714-6dea3d8a5161,revision_number=6']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:51.885506 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:51.885902 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:51.886243 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:51.886569 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:51.886896 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:51.887216 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:51.887531 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:51.887846 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:51.888176 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:51.888492 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:51.888803 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:51.889113 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:16:51.930138 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['fbefda08-fc7a-42a0-b714-6dea3d8a5161'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:16:52.311966 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d557b93d-0010-4893-9ce8-ddcc0c70cfc0 req-676128ab-1f74-4fb1-a587-8f939d37e936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:52.321346 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d557b93d-0010-4893-9ce8-ddcc0c70cfc0 req-676128ab-1f74-4fb1-a587-8f939d37e936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 944 time: 0.0692377 Nov 08 16:16:52.403708 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d557b93d-0010-4893-9ce8-ddcc0c70cfc0 req-27a3fb30-d545-4bfb-a60d-9860da315f2b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0815091 Nov 08 16:16:52.418133 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-948baf70-f260-4a95-96db-b88ddead252a req-78dcc57a-5c51-413d-b138-ec17e07ea121 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:52.419778 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-948baf70-f260-4a95-96db-b88ddead252a req-78dcc57a-5c51-413d-b138-ec17e07ea121 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0958343 Nov 08 16:16:52.481452 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-948baf70-f260-4a95-96db-b88ddead252a req-31b84867-985b-47dd-86eb-0df4d376efcf tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0508201 Nov 08 16:16:52.688604 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 39194) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:53.025298 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a71935bf-5987-459c-a475-2c5d1b502b60 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:53.097673 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a71935bf-5987-459c-a475-2c5d1b502b60 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:53.101373 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a71935bf-5987-459c-a475-2c5d1b502b60 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:53.136895 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a71935bf-5987-459c-a475-2c5d1b502b60 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a55e46d-3eb9-4288-9372-9c4211dbb361,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:53.141094 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-a71935bf-5987-459c-a475-2c5d1b502b60 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=61dd084bd13d49f391b229dc48f29e2b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4507399 Nov 08 16:16:53.144275 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 39206) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:53.188979 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7496260a-8f95-4e9e-9a04-9e61c84fa6b9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:53.210103 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7496260a-8f95-4e9e-9a04-9e61c84fa6b9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:53.254739 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7496260a-8f95-4e9e-9a04-9e61c84fa6b9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:53.257585 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7496260a-8f95-4e9e-9a04-9e61c84fa6b9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:53.258781 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-7496260a-8f95-4e9e-9a04-9e61c84fa6b9 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/9a55e46d-3eb9-4288-9372-9c4211dbb361 HTTP/1.1" status: 204 len: 168 time: 0.1126935 Nov 08 16:16:53.266555 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7496260a-8f95-4e9e-9a04-9e61c84fa6b9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a55e46d-3eb9-4288-9372-9c4211dbb361,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:53.535394 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4dd9d1d-0a35-4107-8733-50263336e65d req-6b74748c-d5ea-4c6a-ad99-7eaccd19619b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:53.536532 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a4dd9d1d-0a35-4107-8733-50263336e65d req-6b74748c-d5ea-4c6a-ad99-7eaccd19619b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 944 time: 0.0540664 Nov 08 16:16:53.539980 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device fbefda08-fc7a-42a0-b714-6dea3d8a5161 up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:16:53.560740 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 39224) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:53.579796 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-bf2ae563-6a24-4e85-9f4f-f5becd9f7fba admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:53.601182 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port fbefda08-fc7a-42a0-b714-6dea3d8a5161 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:16:53.602124 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:53.641361 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a4dd9d1d-0a35-4107-8733-50263336e65d req-130d2fd5-31c6-40df-b5dd-cddfd10409c2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0966096 Nov 08 16:16:53.670399 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e1a03be-8e94-40d2-a9a8-e1d01009d9ac req-785036b8-4be0-47a0-ab99-687a77eeeb7d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:53.673092 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3e1a03be-8e94-40d2-a9a8-e1d01009d9ac req-785036b8-4be0-47a0-ab99-687a77eeeb7d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0960441 Nov 08 16:16:53.691138 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:53.715901 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c1c8c8d-5f78-45fb-803d-8f7a84df3433', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fbefda08-fc7a-42a0-b714-6dea3d8a5161'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:16:53.718262 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-024fc58d-1bb6-4211-a120-04b6bf38ecf7" -d '{"events": [{"server_uuid": "1c1c8c8d-5f78-45fb-803d-8f7a84df3433", "name": "network-vif-plugged", "status": "completed", "tag": "fbefda08-fc7a-42a0-b714-6dea3d8a5161"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:16:53.731562 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port fbefda08-fc7a-42a0-b714-6dea3d8a5161, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=fbefda08-fc7a-42a0-b714-6dea3d8a5161,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:16:53.736685 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:53.756625 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3e1a03be-8e94-40d2-a9a8-e1d01009d9ac req-ee027e51-70a9-4cd8-bfa7-5ad0da3e4f60 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0734568 Nov 08 16:16:53.768670 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-bf2ae563-6a24-4e85-9f4f-f5becd9f7fba admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:53.775826 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-bf2ae563-6a24-4e85-9f4f-f5becd9f7fba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:53.800235 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:16:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-27c58c73-7621-4504-86de-08b437169c9f x-openstack-request-id: req-27c58c73-7621-4504-86de-08b437169c9f {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:16:53.800542 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1c1c8c8d-5f78-45fb-803d-8f7a84df3433", "name": "network-vif-plugged", "status": "completed", "tag": "fbefda08-fc7a-42a0-b714-6dea3d8a5161", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:16:53.800849 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-27c58c73-7621-4504-86de-08b437169c9f {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:16:53.801240 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c1c8c8d-5f78-45fb-803d-8f7a84df3433', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fbefda08-fc7a-42a0-b714-6dea3d8a5161', 'code': 200} Nov 08 16:16:53.812833 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=fbefda08-fc7a-42a0-b714-6dea3d8a5161,revision_number=7']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:53.816731 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-bf2ae563-6a24-4e85-9f4f-f5becd9f7fba admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=61376c3e67314771975ef652bae41f8c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2546492 Nov 08 16:16:53.818923 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf2ae563-6a24-4e85-9f4f-f5becd9f7fba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=815af48a-d54e-457f-9abc-7d6c97766c15,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:53.819073 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 39234) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:53.869385 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9f2e799d-e3a6-4599-9854-a647d24f18db admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:53.891072 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9f2e799d-e3a6-4599-9854-a647d24f18db admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:53.938152 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9f2e799d-e3a6-4599-9854-a647d24f18db admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:53.941291 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9f2e799d-e3a6-4599-9854-a647d24f18db admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:53.942604 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-9f2e799d-e3a6-4599-9854-a647d24f18db admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/815af48a-d54e-457f-9abc-7d6c97766c15 HTTP/1.1" status: 204 len: 168 time: 0.1224272 Nov 08 16:16:53.959116 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f2e799d-e3a6-4599-9854-a647d24f18db admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=815af48a-d54e-457f-9abc-7d6c97766c15,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:16:54.775758 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-337ce024-60c7-4961-89a2-43e546b4f73f req-7cd1a200-39b3-4501-bac1-d0f28d8b88d8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:54.777294 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-337ce024-60c7-4961-89a2-43e546b4f73f req-7cd1a200-39b3-4501-bac1-d0f28d8b88d8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0529966 Nov 08 16:16:54.834199 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-337ce024-60c7-4961-89a2-43e546b4f73f req-11130a20-3d28-462d-a14b-d3d5dee40d41 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0510867 Nov 08 16:16:54.901316 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcdfffc7-3a07-45b6-b4a7-94986de8b479 req-64e45e54-c7cd-40a9-a847-209f789e390b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:54.903489 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bcdfffc7-3a07-45b6-b4a7-94986de8b479 req-64e45e54-c7cd-40a9-a847-209f789e390b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0567820 Nov 08 16:16:54.955403 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bcdfffc7-3a07-45b6-b4a7-94986de8b479 req-3269d30b-724e-466c-9e52-9db131e5bde5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457761 Nov 08 16:16:56.018674 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-852b23ee-f254-4217-be9f-f9edc59921bb req-d28ca229-5f05-40ed-98b4-072e28a36b53 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:56.021122 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-852b23ee-f254-4217-be9f-f9edc59921bb req-d28ca229-5f05-40ed-98b4-072e28a36b53 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0732937 Nov 08 16:16:56.102150 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-852b23ee-f254-4217-be9f-f9edc59921bb req-1c006a41-a772-46cc-9612-206a5683ec9a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0749192 Nov 08 16:16:56.118990 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebdbf079-757e-4643-85af-9c15ba1522f6 req-aa35f098-94dc-40c1-8d01-a93e931c987b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:56.120458 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ebdbf079-757e-4643-85af-9c15ba1522f6 req-aa35f098-94dc-40c1-8d01-a93e931c987b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0764968 Nov 08 16:16:56.182186 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ebdbf079-757e-4643-85af-9c15ba1522f6 req-2d567c09-e49c-42b3-9263-87ce58bd6535 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0523427 Nov 08 16:16:56.412260 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8089f173-27f9-4a14-b2b4-1b0db4692776 req-b5a82312-0040-4d9f-adac-ff8f66fd129f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:56.413962 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8089f173-27f9-4a14-b2b4-1b0db4692776 req-b5a82312-0040-4d9f-adac-ff8f66fd129f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0519152 Nov 08 16:16:56.472003 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8089f173-27f9-4a14-b2b4-1b0db4692776 req-a8e35711-1982-47f5-9979-a9b54b2fbb4c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0519879 Nov 08 16:16:56.582795 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50eb3b3a-287c-48c8-81a2-300ffa70b884 req-d146fa48-a240-4715-9eaa-420554ea5104 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:56.584806 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-50eb3b3a-287c-48c8-81a2-300ffa70b884 req-d146fa48-a240-4715-9eaa-420554ea5104 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=f6e779f0506643d08d984c2971d5a71c&device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 1098 time: 0.1454561 Nov 08 16:16:56.691943 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50eb3b3a-287c-48c8-81a2-300ffa70b884 req-1745d729-41e5-49f4-a7ae-2f283686cf78 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:56.694093 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-50eb3b3a-287c-48c8-81a2-300ffa70b884 req-1745d729-41e5-49f4-a7ae-2f283686cf78 service neutron] 10.222.0.25 "GET /v2.0/networks?id=75fa9c3e-7bfe-490a-9118-221394c29646 HTTP/1.1" status: 200 len: 911 time: 0.0954695 Nov 08 16:16:56.773838 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-50eb3b3a-287c-48c8-81a2-300ffa70b884 req-090270a8-fd7f-46a1-bccb-1910bb3bdb84 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f4784d76-6af7-4b31-a9f3-ee25c9087b51 HTTP/1.1" status: 200 len: 1000 time: 0.0700958 Nov 08 16:16:56.835136 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50eb3b3a-287c-48c8-81a2-300ffa70b884 req-2180a8b7-de17-42a9-b809-8d5f13397d4d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:56.836628 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-50eb3b3a-287c-48c8-81a2-300ffa70b884 req-2180a8b7-de17-42a9-b809-8d5f13397d4d service neutron] 10.222.0.25 "GET /v2.0/subnets?id=8b248e51-4c70-4980-9452-c6b625bf96dd HTTP/1.1" status: 200 len: 849 time: 0.0539827 Nov 08 16:16:56.900711 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50eb3b3a-287c-48c8-81a2-300ffa70b884 req-d014ded7-419b-4e42-9778-54598c004a7e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:56.902225 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-50eb3b3a-287c-48c8-81a2-300ffa70b884 req-d014ded7-419b-4e42-9778-54598c004a7e service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=75fa9c3e-7bfe-490a-9118-221394c29646&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0551169 Nov 08 16:16:57.010797 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-50eb3b3a-287c-48c8-81a2-300ffa70b884 req-12d9663b-2569-4a35-b2cc-06942f9660e1 service neutron] 10.222.0.25 "GET /v2.0/networks/75fa9c3e-7bfe-490a-9118-221394c29646?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0998914 Nov 08 16:16:57.151707 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-50eb3b3a-287c-48c8-81a2-300ffa70b884 req-3a1f7658-5dd4-45c0-9776-be5e3277217c service neutron] 10.222.0.25 "GET /v2.0/networks/75fa9c3e-7bfe-490a-9118-221394c29646?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1334200 Nov 08 16:16:57.242590 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d816a540-ed55-47c8-beae-a0a74af3577c req-804b3951-7526-4197-ae7d-164ac44d9c28 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:57.244333 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d816a540-ed55-47c8-beae-a0a74af3577c req-804b3951-7526-4197-ae7d-164ac44d9c28 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0580173 Nov 08 16:16:57.305292 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d816a540-ed55-47c8-beae-a0a74af3577c req-f8794712-e764-46be-ae5d-466b3ffad55c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0524347 Nov 08 16:16:57.653759 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3141dfe-cee7-47e9-960e-7b1078c4539e req-94c6a899-9668-4857-841f-d19bf9bf26fd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:57.654995 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f3141dfe-cee7-47e9-960e-7b1078c4539e req-94c6a899-9668-4857-841f-d19bf9bf26fd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.1047630 Nov 08 16:16:57.712536 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f3141dfe-cee7-47e9-960e-7b1078c4539e req-8ee52654-1d76-46e0-9ed5-de56101b7e62 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0515993 Nov 08 16:16:58.463649 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17db2660-f4ba-4c43-a7f1-dd60a6aa85f9 req-84f8f2ab-69a8-48ba-aff6-65e358a052dd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:58.465662 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-17db2660-f4ba-4c43-a7f1-dd60a6aa85f9 req-84f8f2ab-69a8-48ba-aff6-65e358a052dd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0779335 Nov 08 16:16:58.548069 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-17db2660-f4ba-4c43-a7f1-dd60a6aa85f9 req-28e44d34-5781-4cf6-a9d8-1765d70a5f98 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0714412 Nov 08 16:16:58.886119 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64fd4f71-e209-4869-936e-c8cef81530b9 req-b7091010-8298-44d4-8b42-b7e925e31149 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:58.888729 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-64fd4f71-e209-4869-936e-c8cef81530b9 req-b7091010-8298-44d4-8b42-b7e925e31149 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0558674 Nov 08 16:16:58.963417 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-64fd4f71-e209-4869-936e-c8cef81530b9 req-14eef964-189a-4545-a374-a021eafe0bab tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0672550 Nov 08 16:16:59.769234 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 39514) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:59.779152 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3313a5b9-51a7-4d59-9b78-468a66b0182f req-73a72505-2953-4698-84a5-fb54e7a8bed0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:16:59.792860 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3313a5b9-51a7-4d59-9b78-468a66b0182f req-73a72505-2953-4698-84a5-fb54e7a8bed0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.1180637 Nov 08 16:16:59.868921 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 39520) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:16:59.873610 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3313a5b9-51a7-4d59-9b78-468a66b0182f req-fe144d2e-85d9-4acc-96f1-3ce5f6bfa3e7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0708601 Nov 08 16:16:59.947784 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_v2 [None req-5ec958b7-5b66-45e7-b3a1-5db6d28834b1 admin admin] Deleting subnet 1f439244-c92a-4099-b428-ff553d72eb05 {{(pid=101245) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 16:16:59.965426 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5ec958b7-5b66-45e7-b3a1-5db6d28834b1 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:16:59.967532 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-94dde347-3512-4125-b4dd-8036ddd98d5b admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:00.027792 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5ec958b7-5b66-45e7-b3a1-5db6d28834b1 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5113603'] for subnet, precommit_delete_associations {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:00.090556 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5ec958b7-5b66-45e7-b3a1-5db6d28834b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-872226'] for subnet, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:00.149802 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-94dde347-3512-4125-b4dd-8036ddd98d5b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:00.156371 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-94dde347-3512-4125-b4dd-8036ddd98d5b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:00.184566 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5ec958b7-5b66-45e7-b3a1-5db6d28834b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-872235', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7464090', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6098572'] for subnet, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:00.222792 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94dde347-3512-4125-b4dd-8036ddd98d5b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0e8508a5-a339-46c8-b73f-914dc96ede71,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:00.228565 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ec958b7-5b66-45e7-b3a1-5db6d28834b1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1f439244-c92a-4099-b428-ff553d72eb05,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:00.231469 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5ec958b7-5b66-45e7-b3a1-5db6d28834b1 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:00.236347 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-5ec958b7-5b66-45e7-b3a1-5db6d28834b1 admin admin] 10.222.0.37 "DELETE /v2.0/subnets/1f439244-c92a-4099-b428-ff553d72eb05 HTTP/1.1" status: 204 len: 168 time: 0.3637297 Nov 08 16:17:00.241604 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 39522) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:17:00.241767 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-94dde347-3512-4125-b4dd-8036ddd98d5b admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=22c54c67a286455ebd340a3e08ef63d3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4689853 Nov 08 16:17:00.241978 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 39524) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:17:00.299360 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1f69db2f-2942-4f37-a2ec-c7429fbd0939 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:00.318689 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b07ea1db-25cf-4c11-b8d1-ebcf68ef732e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1007047'] for network, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:00.333142 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1f69db2f-2942-4f37-a2ec-c7429fbd0939 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:00.395457 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1f69db2f-2942-4f37-a2ec-c7429fbd0939 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:00.398208 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1f69db2f-2942-4f37-a2ec-c7429fbd0939 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:00.399354 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-1f69db2f-2942-4f37-a2ec-c7429fbd0939 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/0e8508a5-a339-46c8-b73f-914dc96ede71 HTTP/1.1" status: 204 len: 168 time: 0.1563988 Nov 08 16:17:00.410491 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f69db2f-2942-4f37-a2ec-c7429fbd0939 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e8508a5-a339-46c8-b73f-914dc96ede71,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:00.732742 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b07ea1db-25cf-4c11-b8d1-ebcf68ef732e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-869719', 'neutron.services.segments.db._delete_segments_for_network-8792877333297'] for network, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:00.774068 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-b07ea1db-25cf-4c11-b8d1-ebcf68ef732e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['63da175a-847c-472d-b285-2df5d0b798a0']}} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:17:00.793592 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-b07ea1db-25cf-4c11-b8d1-ebcf68ef732e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd89c6b3f-ecc6-4296-92e8-9f4a30c70af3') {'for_net_delete': True} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:17:00.794401 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-b07ea1db-25cf-4c11-b8d1-ebcf68ef732e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd89c6b3f-ecc6-4296-92e8-9f4a30c70af3') {} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:17:00.811483 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b07ea1db-25cf-4c11-b8d1-ebcf68ef732e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792877333818', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8047118'] for segment, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:00.830503 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b07ea1db-25cf-4c11-b8d1-ebcf68ef732e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:00.840399 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b07ea1db-25cf-4c11-b8d1-ebcf68ef732e admin admin] Releasing vlan 155 on physical network physnet1 to pool {{(pid=101244) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 16:17:00.841315 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b07ea1db-25cf-4c11-b8d1-ebcf68ef732e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4227628'] for segment, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: Traceback (most recent call last): Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: timer() Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: cb(*args, **kw) Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: return func(*args, **kwargs) Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: self._notify() Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: self.callback(batched_events) Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: event.method(event) Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: return f(self, *a, **k) Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: return self._get(url).json() Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: return self.request(url, 'GET', **kwargs) Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 16:17:00.843691 dv-cinder-816187-2-iscsi neutron-server[101244]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 16:17:00.920507 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b07ea1db-25cf-4c11-b8d1-ebcf68ef732e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-868772', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-2032313'] for network, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:00.933792 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b07ea1db-25cf-4c11-b8d1-ebcf68ef732e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:00.940419 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-b07ea1db-25cf-4c11-b8d1-ebcf68ef732e admin admin] 10.222.0.37 "DELETE /v2.0/networks/63da175a-847c-472d-b285-2df5d0b798a0 HTTP/1.1" status: 204 len: 168 time: 0.7003262 Nov 08 16:17:00.954847 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b07ea1db-25cf-4c11-b8d1-ebcf68ef732e admin admin] Pushing event deleted for resources: {'Network': ['ID=63da175a-847c-472d-b285-2df5d0b798a0,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:01.033685 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06255980-c580-4809-a03a-38ac8fb9938d req-ea7a6035-50be-49c6-b7d3-b1a3e19e2417 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:01.035732 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-06255980-c580-4809-a03a-38ac8fb9938d req-ea7a6035-50be-49c6-b7d3-b1a3e19e2417 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0522232 Nov 08 16:17:01.115440 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-06255980-c580-4809-a03a-38ac8fb9938d req-21f4a354-5c66-41e2-a957-6718476b436e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0736954 Nov 08 16:17:01.222147 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 39546) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:17:01.224753 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 39548) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:17:01.293558 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-d4fd55d2-4a9d-4277-866c-d68825a3d44e admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=e5e827086bb348d190546b9a0c0ba087&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0676615 Nov 08 16:17:01.296076 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 39554) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:17:01.351842 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f19dd19c-4059-499a-9d79-1b3c2b794bf1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:01.376989 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f19dd19c-4059-499a-9d79-1b3c2b794bf1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:01.437267 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f19dd19c-4059-499a-9d79-1b3c2b794bf1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:01.443168 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f19dd19c-4059-499a-9d79-1b3c2b794bf1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:01.448459 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-f19dd19c-4059-499a-9d79-1b3c2b794bf1 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/5158333e-8a1f-4579-b040-8c9e867322b3 HTTP/1.1" status: 204 len: 168 time: 0.1513770 Nov 08 16:17:01.456925 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f19dd19c-4059-499a-9d79-1b3c2b794bf1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5158333e-8a1f-4579-b040-8c9e867322b3,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:01.531783 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-20096630-b008-42d0-ba91-77e84ff07176 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:01.618906 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-20096630-b008-42d0-ba91-77e84ff07176 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:01.624789 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-20096630-b008-42d0-ba91-77e84ff07176 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:01.670615 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 39558) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:17:01.671875 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-20096630-b008-42d0-ba91-77e84ff07176 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=c97ab6c57f564eefacf307be691a4e3a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4446480 Nov 08 16:17:01.676481 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20096630-b008-42d0-ba91-77e84ff07176 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0eb968e6-7372-4612-89ad-4d605a4f134b,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:01.732440 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-668063c5-3c1b-4722-81ee-fb202b7edc1f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:01.762294 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-668063c5-3c1b-4722-81ee-fb202b7edc1f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:01.835869 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-668063c5-3c1b-4722-81ee-fb202b7edc1f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:01.840176 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-668063c5-3c1b-4722-81ee-fb202b7edc1f admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:01.847870 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-668063c5-3c1b-4722-81ee-fb202b7edc1f admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/0eb968e6-7372-4612-89ad-4d605a4f134b HTTP/1.1" status: 204 len: 168 time: 0.1729426 Nov 08 16:17:01.866390 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-668063c5-3c1b-4722-81ee-fb202b7edc1f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0eb968e6-7372-4612-89ad-4d605a4f134b,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:02.275368 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bed98680-05d1-409f-914c-7a6c38b462ba req-f4abd735-057d-4509-8169-1371a7fee1ac tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:02.283290 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bed98680-05d1-409f-914c-7a6c38b462ba req-f4abd735-057d-4509-8169-1371a7fee1ac tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0720620 Nov 08 16:17:02.332478 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 39582) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:17:02.344365 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bed98680-05d1-409f-914c-7a6c38b462ba req-5280450e-0f6a-4b0d-9582-d50662e7fe76 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0572970 Nov 08 16:17:02.367089 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d78c7367-136d-4d54-a461-645cfbba16cc admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:02.464615 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d78c7367-136d-4d54-a461-645cfbba16cc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:02.472181 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 39586) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:17:02.472927 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d78c7367-136d-4d54-a461-645cfbba16cc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:02.506129 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d78c7367-136d-4d54-a461-645cfbba16cc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=03181151-1c1e-4eb2-9638-6aa6cbdaf6e8,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:02.521762 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-d78c7367-136d-4d54-a461-645cfbba16cc admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=0e2edd2dccf04507a3ca2d1ac50d9e39&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1850185 Nov 08 16:17:02.523021 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 39590) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:17:02.586748 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-af441ccb-94ea-4587-bfa8-7656f5cff622 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:02.614218 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-624e383a-f041-4192-b7ad-d0dd2928f863 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-138746869-network', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:17:02.632638 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-af441ccb-94ea-4587-bfa8-7656f5cff622 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:02.653750 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-624e383a-f041-4192-b7ad-d0dd2928f863 admin admin] Made reservation on behalf of 9ad6e5c060034b2ca263bfdcb07fe807 for: {'network': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:17:02.656111 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-624e383a-f041-4192-b7ad-d0dd2928f863 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for network, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:02.671551 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-624e383a-f041-4192-b7ad-d0dd2928f863 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:02.724651 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-af441ccb-94ea-4587-bfa8-7656f5cff622 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:02.727478 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-af441ccb-94ea-4587-bfa8-7656f5cff622 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:02.728751 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-af441ccb-94ea-4587-bfa8-7656f5cff622 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/03181151-1c1e-4eb2-9638-6aa6cbdaf6e8 HTTP/1.1" status: 204 len: 168 time: 0.2044895 Nov 08 16:17:02.742905 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af441ccb-94ea-4587-bfa8-7656f5cff622 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=03181151-1c1e-4eb2-9638-6aa6cbdaf6e8,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:02.792548 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-624e383a-f041-4192-b7ad-d0dd2928f863 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:02.798996 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-624e383a-f041-4192-b7ad-d0dd2928f863 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:02.829234 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-624e383a-f041-4192-b7ad-d0dd2928f863 admin admin] vlan segment allocate from pool success with {'vlan_id': 179, 'physical_network': 'physnet1'} {{(pid=101244) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 16:17:02.841028 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-624e383a-f041-4192-b7ad-d0dd2928f863 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1d0afe5a-015d-4e87-a876-479fff7e7b28,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:02.846408 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-624e383a-f041-4192-b7ad-d0dd2928f863 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:02.846871 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.db.segments_db [None req-624e383a-f041-4192-b7ad-d0dd2928f863 admin admin] Added segment 1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3 of type vlan for network 52eb1d65-dc7c-45c5-9521-97cb18715837 Nov 08 16:17:02.890147 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-624e383a-f041-4192-b7ad-d0dd2928f863 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792876766172'] for network, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:02.946034 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-624e383a-f041-4192-b7ad-d0dd2928f863 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for network, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:02.947057 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-624e383a-f041-4192-b7ad-d0dd2928f863 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:02.947713 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-624e383a-f041-4192-b7ad-d0dd2928f863 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:03.012397 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-624e383a-f041-4192-b7ad-d0dd2928f863 admin admin] 10.222.0.37 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.5391140 Nov 08 16:17:03.015313 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 39602) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:17:03.021558 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-f93187f0-9da4-4505-a7e8-2919c906103e admin admin] Request body: {'subnet': {'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-138746869-subnet', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'ip_version': 4}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:17:03.026266 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-624e383a-f041-4192-b7ad-d0dd2928f863 admin admin] Pushing event updated for resources: {'Network': ['ID=52eb1d65-dc7c-45c5-9521-97cb18715837,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:03.039845 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Network 52eb1d65-dc7c-45c5-9521-97cb18715837 details requested by agent ovs-agent-dv-cinder-816187-2-iscsi with host dv-cinder-816187-2-iscsi {{(pid=101246) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 16:17:03.077655 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f93187f0-9da4-4505-a7e8-2919c906103e admin admin] Made reservation on behalf of 9ad6e5c060034b2ca263bfdcb07fe807 for: {'subnet': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:17:03.080750 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f93187f0-9da4-4505-a7e8-2919c906103e admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-6098797'] for subnet, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:03.310891 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f93187f0-9da4-4505-a7e8-2919c906103e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7464155', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-6098583'] for subnet, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:03.368508 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f93187f0-9da4-4505-a7e8-2919c906103e admin admin] Pushing event updated for resources: {'Subnet': ['ID=12999abd-2828-4905-aed0-938c2f27aed8,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:03.398138 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f93187f0-9da4-4505-a7e8-2919c906103e admin admin] Checking segment: {'id': '1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 179, 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:17:03.398496 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f93187f0-9da4-4505-a7e8-2919c906103e admin admin] Network hostable DHCP agents. Network: 52eb1d65-dc7c-45c5-9521-97cb18715837, hostable agents: ['a7e1e7ee-1ce2-474e-9688-58f0884991a4'], hosted agents: [] {{(pid=101245) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 16:17:03.418054 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f93187f0-9da4-4505-a7e8-2919c906103e admin admin] Network 52eb1d65-dc7c-45c5-9521-97cb18715837 is scheduled to be hosted by DHCP agent a7e1e7ee-1ce2-474e-9688-58f0884991a4 with binding_index 1 {{(pid=101245) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 16:17:03.441138 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-f93187f0-9da4-4505-a7e8-2919c906103e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816187-2-iscsi, 52eb1d65-dc7c-45c5-9521-97cb18715837) {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:17:03.447179 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f93187f0-9da4-4505-a7e8-2919c906103e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:03.447829 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f93187f0-9da4-4505-a7e8-2919c906103e admin admin] Publish callbacks [] for subnet, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:03.456304 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e44daab7-2b4a-4800-aa78-bbb0f49bd071 None None] Network 52eb1d65-dc7c-45c5-9521-97cb18715837 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:17:03.487293 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-f93187f0-9da4-4505-a7e8-2919c906103e admin admin] 10.222.0.37 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.4703805 Nov 08 16:17:03.487977 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 39618) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:17:03.495112 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-ed11645a-b838-4e75-87de-d87d6e4267d2 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-138746869-router', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:17:03.554001 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ed11645a-b838-4e75-87de-d87d6e4267d2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-2034701', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-12912'] for router, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:03.555051 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ed11645a-b838-4e75-87de-d87d6e4267d2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-2034873', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-2032180', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-2080911', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-12873'] for router, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:03.572395 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18eef6b4-45ed-4726-8eb3-ba7ef0f2c35e req-e2f7612a-b780-40a9-9cc2-654e8f5559d6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:03.573974 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-18eef6b4-45ed-4726-8eb3-ba7ef0f2c35e req-e2f7612a-b780-40a9-9cc2-654e8f5559d6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.1159627 Nov 08 16:17:03.627658 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-18eef6b4-45ed-4726-8eb3-ba7ef0f2c35e req-7007122d-00d0-49f5-a491-39400e6fce52 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453556 Nov 08 16:17:03.646099 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ed11645a-b838-4e75-87de-d87d6e4267d2 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:03.703859 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c18fc08-cfe3-431f-b23d-e4b36e8f7b61 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp66bc375f-c06b-591f-b467-1ee6ff0ebcc7-52eb1d65-dc7c-45c5-9521-97cb18715837', 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'fixed_ips': [{'subnet_id': '12999abd-2828-4905-aed0-938c2f27aed8'}]}} from dv-cinder-816187-2-iscsi. {{(pid=101246) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 08 16:17:03.705163 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7c18fc08-cfe3-431f-b23d-e4b36e8f7b61 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:03.826006 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ed11645a-b838-4e75-87de-d87d6e4267d2 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:03.908670 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.db_base_plugin_common [None req-7c18fc08-cfe3-431f-b23d-e4b36e8f7b61 None None] Allocated IP 172.20.0.2 (52eb1d65-dc7c-45c5-9521-97cb18715837/12999abd-2828-4905-aed0-938c2f27aed8/ecf3fe3f-6f7d-43cd-a052-e875b1cc1232) {{(pid=101246) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:17:04.129257 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ed11645a-b838-4e75-87de-d87d6e4267d2 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:04.169957 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7c18fc08-cfe3-431f-b23d-e4b36e8f7b61 None None] Publish callbacks [] for port, precommit_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:04.172999 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ed11645a-b838-4e75-87de-d87d6e4267d2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:04.180476 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7c18fc08-cfe3-431f-b23d-e4b36e8f7b61 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:04.243563 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c18fc08-cfe3-431f-b23d-e4b36e8f7b61 None None] Network 52eb1d65-dc7c-45c5-9521-97cb18715837 is already hosted by enough agents. {{(pid=101246) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:17:04.248601 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.scheduler.base_scheduler [None req-7c18fc08-cfe3-431f-b23d-e4b36e8f7b61 None None] Resources bound (agent type, host, resource id): {{(pid=101246) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:17:04.252118 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c18fc08-cfe3-431f-b23d-e4b36e8f7b61 None None] Received port after_create {{(pid=101246) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:17:04.295450 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c18fc08-cfe3-431f-b23d-e4b36e8f7b61 None None] Pushing event updated for resources: {'Port': ['ID=ecf3fe3f-6f7d-43cd-a052-e875b1cc1232,revision_number=1']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:04.341505 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-7c18fc08-cfe3-431f-b23d-e4b36e8f7b61 None None] Attempting to bind port ecf3fe3f-6f7d-43cd-a052-e875b1cc1232 on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:17:04.342009 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-7c18fc08-cfe3-431f-b23d-e4b36e8f7b61 None None] Attempting to bind port ecf3fe3f-6f7d-43cd-a052-e875b1cc1232 by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': '1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 179, 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837'}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:17:04.342467 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c18fc08-cfe3-431f-b23d-e4b36e8f7b61 None None] Attempting to bind port ecf3fe3f-6f7d-43cd-a052-e875b1cc1232 on network 52eb1d65-dc7c-45c5-9521-97cb18715837 {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:17:04.344516 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_common [None req-ed11645a-b838-4e75-87de-d87d6e4267d2 admin admin] Allocated IP 172.27.3.148 (68f46265-b42a-49a0-8d57-f9362045cd9b/4728e4be-5a19-43c0-89cf-ced2a190645d/67b0adb8-cf59-4b2f-9264-ca9da05f833f) {{(pid=101245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:17:04.353371 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c18fc08-cfe3-431f-b23d-e4b36e8f7b61 None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 16, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:17:04.354143 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c18fc08-cfe3-431f-b23d-e4b36e8f7b61 None None] Checking segment: {'id': '1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 179, 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:17:04.354704 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7c18fc08-cfe3-431f-b23d-e4b36e8f7b61 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:04.355273 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c18fc08-cfe3-431f-b23d-e4b36e8f7b61 None None] Bound using segment: {'id': '1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 179, 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837'} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:17:04.355893 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-7c18fc08-cfe3-431f-b23d-e4b36e8f7b61 None None] Bound port: ecf3fe3f-6f7d-43cd-a052-e875b1cc1232, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 179, 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837'}}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:17:04.356416 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7c18fc08-cfe3-431f-b23d-e4b36e8f7b61 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:04.476124 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-7c18fc08-cfe3-431f-b23d-e4b36e8f7b61 None None] For port ecf3fe3f-6f7d-43cd-a052-e875b1cc1232, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:17:04.483964 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-7c18fc08-cfe3-431f-b23d-e4b36e8f7b61 None None] For port ecf3fe3f-6f7d-43cd-a052-e875b1cc1232, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=ecf3fe3f-6f7d-43cd-a052-e875b1cc1232,segment=NetworkSegment(1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3),segment_id=1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3)] {{(pid=101246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:17:04.497543 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7c18fc08-cfe3-431f-b23d-e4b36e8f7b61 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:04.507616 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ed11645a-b838-4e75-87de-d87d6e4267d2 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:04.579186 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c18fc08-cfe3-431f-b23d-e4b36e8f7b61 None None] Pushing event updated for resources: {'Port': ['ID=ecf3fe3f-6f7d-43cd-a052-e875b1cc1232,revision_number=2']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:04.594707 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ed11645a-b838-4e75-87de-d87d6e4267d2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:04.655158 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed11645a-b838-4e75-87de-d87d6e4267d2 admin admin] Network 68f46265-b42a-49a0-8d57-f9362045cd9b is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:17:04.658391 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-ed11645a-b838-4e75-87de-d87d6e4267d2 admin admin] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:17:04.663129 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed11645a-b838-4e75-87de-d87d6e4267d2 admin admin] Received port after_create {{(pid=101245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:17:04.699009 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed11645a-b838-4e75-87de-d87d6e4267d2 admin admin] Pushing event updated for resources: {'Port': ['ID=67b0adb8-cf59-4b2f-9264-ca9da05f833f,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:04.873986 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80b738dc-b5fe-40c1-8578-a6c9b5d9d72c req-2a8fb8c9-38ec-45dd-ac9f-b0878da856e6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:04.882791 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-80b738dc-b5fe-40c1-8578-a6c9b5d9d72c req-2a8fb8c9-38ec-45dd-ac9f-b0878da856e6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.1336851 Nov 08 16:17:05.000418 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-80b738dc-b5fe-40c1-8578-a6c9b5d9d72c req-2ee1c7a4-ce3a-4aa6-b4b2-6540cfaa02c6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1161785 Nov 08 16:17:05.070948 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ed11645a-b838-4e75-87de-d87d6e4267d2 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:05.343150 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ed11645a-b838-4e75-87de-d87d6e4267d2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-2034870', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-2032353'] for router, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:05.534667 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ed11645a-b838-4e75-87de-d87d6e4267d2 admin admin] Router 3aa8420d-7378-4033-af1d-6dae369fd742 is scheduled to L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f with binding_index 1 {{(pid=101245) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 08 16:17:05.627060 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device ecf3fe3f-6f7d-43cd-a052-e875b1cc1232 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:17:05.717850 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ed11645a-b838-4e75-87de-d87d6e4267d2 admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101245) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:17:05.731462 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] Sync routers for ids ['3aa8420d-7378-4033-af1d-6dae369fd742'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:17:05.750538 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ed11645a-b838-4e75-87de-d87d6e4267d2 admin admin] Publish callbacks [] for router, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:05.762220 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-ed11645a-b838-4e75-87de-d87d6e4267d2 admin admin] 10.222.0.37 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 2.2690165 Nov 08 16:17:05.762573 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 39670) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:17:05.777036 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port ecf3fe3f-6f7d-43cd-a052-e875b1cc1232 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:17:05.777397 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:05.814730 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 39672) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:17:05.858173 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] Routers {'3aa8420d-7378-4033-af1d-6dae369fd742'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:17:05.858821 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:16:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['3aa8420d-7378-4033-af1d-6dae369fd742'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:17:05.958495 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-123c65bc-ef4c-4f9f-989e-163fc7ab01c5 None None] Network 52eb1d65-dc7c-45c5-9521-97cb18715837 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:17:05.982404 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f97a4863-d42d-41d2-b949-97ef00659df9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:06.084373 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-7ca3ec0c-b303-46b7-8574-1b22227d2693 None None] Provisioning complete for port ecf3fe3f-6f7d-43cd-a052-e875b1cc1232 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:17:06.088687 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7ca3ec0c-b303-46b7-8574-1b22227d2693 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:06.151160 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f97a4863-d42d-41d2-b949-97ef00659df9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:06.167190 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f97a4863-d42d-41d2-b949-97ef00659df9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:06.220975 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-f97a4863-d42d-41d2-b949-97ef00659df9 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=a3d772ad24e84c4d842575ca6b7ef993&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4048378 Nov 08 16:17:06.222429 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdb85a97-ef95-4307-9e5a-66a7bb7d7647 req-14dabd1a-cf7f-497c-97c9-9d521985dfbd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:06.223945 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fdb85a97-ef95-4307-9e5a-66a7bb7d7647 req-14dabd1a-cf7f-497c-97c9-9d521985dfbd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.1061907 Nov 08 16:17:06.224419 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 39678) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:17:06.239517 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] Set router 3aa8420d-7378-4033-af1d-6dae369fd742 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:17:06.248587 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f97a4863-d42d-41d2-b949-97ef00659df9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4f4ee84b-27e4-4980-bc81-4582c271c489,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:06.309194 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:06.393985 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fdb85a97-ef95-4307-9e5a-66a7bb7d7647 req-0011820f-9116-48c1-a8ae-69817a6956f3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1304133 Nov 08 16:17:06.447482 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9372a2cb-4e00-47c8-86f9-aaeb1a685892 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:06.488181 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9372a2cb-4e00-47c8-86f9-aaeb1a685892 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:06.553449 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5f1b2974-6610-4302-b309-bd4e5295d64d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:06.584818 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] For port ecf3fe3f-6f7d-43cd-a052-e875b1cc1232, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=ecf3fe3f-6f7d-43cd-a052-e875b1cc1232,segment=NetworkSegment(1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3),segment_id=1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:17:06.626126 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:06.671875 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7ca3ec0c-b303-46b7-8574-1b22227d2693 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:06.771957 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Pushing event updated for resources: {'Port': ['ID=ecf3fe3f-6f7d-43cd-a052-e875b1cc1232,revision_number=3']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:06.800806 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [None req-5f1b2974-6610-4302-b309-bd4e5295d64d admin admin] Allocated IP 172.20.0.1 (52eb1d65-dc7c-45c5-9521-97cb18715837/12999abd-2828-4905-aed0-938c2f27aed8/1530a0fe-3181-4905-89a0-9606e9ca5a5f) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:17:06.813159 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.db.api [None req-7ca3ec0c-b303-46b7-8574-1b22227d2693 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=101246) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 08 16:17:06.817613 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG oslo_db.api [None req-7ca3ec0c-b303-46b7-8574-1b22227d2693 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 08 16:17:06.848439 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'name': 'tempest-TestMinimumBasicScenario-138746869-router', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148'}], 'enable_snat': True}, 'gw_port_id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:17:03Z', 'updated_at': '2021-11-08T16:17:04Z', 'revision_number': 3, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'gw_port': {'id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:1c:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:04Z', 'updated_at': '2021-11-08T16:17:04Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:17:06.878013 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] Checking router: 3aa8420d-7378-4033-af1d-6dae369fd742 for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:17:06.878714 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] Updating router 3aa8420d-7378-4033-af1d-6dae369fd742 port 67b0adb8-cf59-4b2f-9264-ca9da05f833f binding host dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 16:17:06.931540 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:06.962094 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9372a2cb-4e00-47c8-86f9-aaeb1a685892 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:06.964808 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9372a2cb-4e00-47c8-86f9-aaeb1a685892 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:06.971407 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-9372a2cb-4e00-47c8-86f9-aaeb1a685892 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/4f4ee84b-27e4-4980-bc81-4582c271c489 HTTP/1.1" status: 204 len: 168 time: 0.7441919 Nov 08 16:17:06.998267 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9372a2cb-4e00-47c8-86f9-aaeb1a685892 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4f4ee84b-27e4-4980-bc81-4582c271c489,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:07.035728 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5f1b2974-6610-4302-b309-bd4e5295d64d admin admin] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:07.103408 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5f1b2974-6610-4302-b309-bd4e5295d64d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:07.184804 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f1b2974-6610-4302-b309-bd4e5295d64d admin admin] Network 52eb1d65-dc7c-45c5-9521-97cb18715837 is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:17:07.201092 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-5f1b2974-6610-4302-b309-bd4e5295d64d admin admin] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:17:07.208232 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f1b2974-6610-4302-b309-bd4e5295d64d admin admin] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:17:07.217582 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f1b2974-6610-4302-b309-bd4e5295d64d admin admin] Pushing event updated for resources: {'Port': ['ID=1530a0fe-3181-4905-89a0-9606e9ca5a5f,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:07.294257 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5f1b2974-6610-4302-b309-bd4e5295d64d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-2033204'] for router_interface, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:07.419911 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] Publish callbacks [] for port, precommit_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:07.436829 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:07.524448 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5f1b2974-6610-4302-b309-bd4e5295d64d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:07.533975 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] Attempting to bind port 67b0adb8-cf59-4b2f-9264-ca9da05f833f on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:17:07.541660 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] Attempting to bind port 67b0adb8-cf59-4b2f-9264-ca9da05f833f by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:17:07.542466 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] Attempting to bind port 67b0adb8-cf59-4b2f-9264-ca9da05f833f on network 68f46265-b42a-49a0-8d57-f9362045cd9b {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:17:07.569439 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15ba1be4-6be1-4852-a75b-9a372f10681b None None] Pushing event updated for resources: {'Port': ['ID=67b0adb8-cf59-4b2f-9264-ca9da05f833f,revision_number=2']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:07.623095 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 16, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:17:07.623570 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] Checking segment: {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:17:07.624822 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:07.625273 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] Bound using segment: {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:17:07.625897 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] Bound port: 67b0adb8-cf59-4b2f-9264-ca9da05f833f, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:17:07.626887 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:07.655686 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device ecf3fe3f-6f7d-43cd-a052-e875b1cc1232 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:17:07.684687 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 39686) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:17:07.698810 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bbbc3c90-66f8-4537-b897-f1be26d3800f admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:07.721903 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-d213b4b9-148e-464e-82bf-054569cf1d4b None None] Provisioning complete for port ecf3fe3f-6f7d-43cd-a052-e875b1cc1232 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:17:07.722367 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-d213b4b9-148e-464e-82bf-054569cf1d4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:07.794555 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08b50cef-3b20-44d0-9f77-0ed0b37c2526 req-7640af6c-1f98-4398-bec3-3622b42be051 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:07.797099 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-08b50cef-3b20-44d0-9f77-0ed0b37c2526 req-7640af6c-1f98-4398-bec3-3622b42be051 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.1591382 Nov 08 16:17:07.797482 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bbbc3c90-66f8-4537-b897-f1be26d3800f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:07.803561 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bbbc3c90-66f8-4537-b897-f1be26d3800f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:07.843217 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5f1b2974-6610-4302-b309-bd4e5295d64d admin admin] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:07.854756 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] For port 67b0adb8-cf59-4b2f-9264-ca9da05f833f, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:17:07.858037 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] For port 67b0adb8-cf59-4b2f-9264-ca9da05f833f, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=67b0adb8-cf59-4b2f-9264-ca9da05f833f,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:17:07.858626 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5f1b2974-6610-4302-b309-bd4e5295d64d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:07.859033 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-bbbc3c90-66f8-4537-b897-f1be26d3800f admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=4c19a679fac04375a1d73bc5387aa58d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1733420 Nov 08 16:17:07.862200 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 39692) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:17:07.871979 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbbc3c90-66f8-4537-b897-f1be26d3800f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b900b3d8-f0e4-4866-af76-4f130a10c31d,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:07.878275 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:07.913396 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port ecf3fe3f-6f7d-43cd-a052-e875b1cc1232 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:17:07.913831 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:07.931916 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1e249014-466e-41e3-b2da-67eb671ea8eb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:07.961116 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-08b50cef-3b20-44d0-9f77-0ed0b37c2526 req-bf16c9d3-47d8-49e8-bc2f-c0fd4bc6e625 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1457970 Nov 08 16:17:07.979802 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5f1b2974-6610-4302-b309-bd4e5295d64d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1599525', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-2033312'] for router_interface, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:07.980244 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1e249014-466e-41e3-b2da-67eb671ea8eb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:07.986209 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f1b2974-6610-4302-b309-bd4e5295d64d admin admin] Pushing event updated for resources: {'Port': ['ID=1530a0fe-3181-4905-89a0-9606e9ca5a5f,revision_number=2']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:08.021522 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15ba1be4-6be1-4852-a75b-9a372f10681b None None] Pushing event updated for resources: {'Port': ['ID=67b0adb8-cf59-4b2f-9264-ca9da05f833f,revision_number=3']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:08.031093 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-4b8466c8-0cd2-4862-bb28-4b4a139b82a3 None None] Provisioning complete for port 1530a0fe-3181-4905-89a0-9606e9ca5a5f triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:17:08.031460 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-4b8466c8-0cd2-4862-bb28-4b4a139b82a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:08.087791 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] Routers {'3aa8420d-7378-4033-af1d-6dae369fd742'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:17:08.090160 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:16:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['3aa8420d-7378-4033-af1d-6dae369fd742'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:17:08.095484 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1e249014-466e-41e3-b2da-67eb671ea8eb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:08.099271 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1e249014-466e-41e3-b2da-67eb671ea8eb admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:08.099271 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-1e249014-466e-41e3-b2da-67eb671ea8eb admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/b900b3d8-f0e4-4866-af76-4f130a10c31d HTTP/1.1" status: 204 len: 168 time: 0.2357605 Nov 08 16:17:08.108015 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e249014-466e-41e3-b2da-67eb671ea8eb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b900b3d8-f0e4-4866-af76-4f130a10c31d,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:08.133530 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f1b2974-6610-4302-b309-bd4e5295d64d admin admin] Network 52eb1d65-dc7c-45c5-9521-97cb18715837 is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:17:08.135391 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-5f1b2974-6610-4302-b309-bd4e5295d64d admin admin] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:17:08.158475 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-4b8466c8-0cd2-4862-bb28-4b4a139b82a3 None None] Port 1530a0fe-3181-4905-89a0-9606e9ca5a5f cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:17:08.249629 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6a92cdd0-98b8-48e6-a43b-be8c367ad1e8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:08.352766 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] Set router 3aa8420d-7378-4033-af1d-6dae369fd742 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:17:08.370834 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5f1b2974-6610-4302-b309-bd4e5295d64d admin admin] Router 3aa8420d-7378-4033-af1d-6dae369fd742 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:17:08.542368 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5f1b2974-6610-4302-b309-bd4e5295d64d admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:17:08.551489 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-5f1b2974-6610-4302-b309-bd4e5295d64d admin admin] 10.222.0.37 "PUT /v2.0/routers/3aa8420d-7378-4033-af1d-6dae369fd742/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7878377 Nov 08 16:17:08.624225 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-c966efb1-be5a-4d40-8e18-318e366bcbb5 None None] Provisioning complete for port 1530a0fe-3181-4905-89a0-9606e9ca5a5f triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:17:08.624616 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-c966efb1-be5a-4d40-8e18-318e366bcbb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:08.686612 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-c966efb1-be5a-4d40-8e18-318e366bcbb5 None None] Port 1530a0fe-3181-4905-89a0-9606e9ca5a5f cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:17:08.748094 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'name': 'tempest-TestMinimumBasicScenario-138746869-router', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148'}], 'enable_snat': True}, 'gw_port_id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:17:03Z', 'updated_at': '2021-11-08T16:17:07Z', 'revision_number': 4, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'gw_port': {'id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:1c:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:04Z', 'updated_at': '2021-11-08T16:17:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '1530a0fe-3181-4905-89a0-9606e9ca5a5f', 'name': '', 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'mac_address': 'fa:16:3e:20:1e:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'device_owner': 'network:router_interface', 'standard_attr_id': 479, 'fixed_ips': [{'subnet_id': '12999abd-2828-4905-aed0-938c2f27aed8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:06Z', 'updated_at': '2021-11-08T16:17:07Z', 'revision_number': 2, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'subnets': [{'id': '12999abd-2828-4905-aed0-938c2f27aed8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:17:08.778246 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b66e77f2-d94e-4d0a-8496-ca6aeb453f13 None None] The sync data for ids ['3aa8420d-7378-4033-af1d-6dae369fd742'] in dv-cinder-816187-2-iscsi is: [{'id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'name': 'tempest-TestMinimumBasicScenario-138746869-router', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148'}], 'enable_snat': True}, 'gw_port_id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:17:03Z', 'updated_at': '2021-11-08T16:17:07Z', 'revision_number': 4, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'gw_port': {'id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:1c:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:04Z', 'updated_at': '2021-11-08T16:17:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '1530a0fe-3181-4905-89a0-9606e9ca5a5f', 'name': '', 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'mac_address': 'fa:16:3e:20:1e:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'device_owner': 'network:router_interface', 'standard_attr_id': 479, 'fixed_ips': [{'subnet_id': '12999abd-2828-4905-aed0-938c2f27aed8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:06Z', 'updated_at': '2021-11-08T16:17:07Z', 'revision_number': 2, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'subnets': [{'id': '12999abd-2828-4905-aed0-938c2f27aed8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:17:09.195841 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f509f9e7-6c5a-4a7b-8a18-bf20800733c9 req-98c9d911-e58d-4c8c-b365-6e27a7042884 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:09.200587 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f509f9e7-6c5a-4a7b-8a18-bf20800733c9 req-98c9d911-e58d-4c8c-b365-6e27a7042884 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.1326466 Nov 08 16:17:09.273070 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f509f9e7-6c5a-4a7b-8a18-bf20800733c9 req-c7f3e5c9-9b3e-43be-8e64-6d21f2bf200c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0655434 Nov 08 16:17:09.334853 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 39738) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:17:09.341508 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-9e1a908e-b9f1-4c79-9634-af9b40c113f5 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-292743942-network', 'tenant_id': '9aa725833c2f4f209193bd189d5e5828'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:17:09.367072 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9e1a908e-b9f1-4c79-9634-af9b40c113f5 admin admin] Made reservation on behalf of 9aa725833c2f4f209193bd189d5e5828 for: {'network': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:17:09.369732 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9e1a908e-b9f1-4c79-9634-af9b40c113f5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for network, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:09.381238 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9e1a908e-b9f1-4c79-9634-af9b40c113f5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:09.473065 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9e1a908e-b9f1-4c79-9634-af9b40c113f5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:09.477963 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9e1a908e-b9f1-4c79-9634-af9b40c113f5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:09.507858 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9e1a908e-b9f1-4c79-9634-af9b40c113f5 admin admin] vlan segment allocate from pool success with {'vlan_id': 172, 'physical_network': 'physnet1'} {{(pid=101245) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 16:17:09.514535 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e1a908e-b9f1-4c79-9634-af9b40c113f5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fdcb0b25-d45a-4090-8db2-02384b3cda03,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:09.522152 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9e1a908e-b9f1-4c79-9634-af9b40c113f5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:09.522645 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.db.segments_db [None req-9e1a908e-b9f1-4c79-9634-af9b40c113f5 admin admin] Added segment d39e409c-0d63-45bc-961f-deac71fbc480 of type vlan for network 4147c9ec-e793-4b9d-9d14-0919c75accc6 Nov 08 16:17:09.571370 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9e1a908e-b9f1-4c79-9634-af9b40c113f5 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792876766172'] for network, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:09.607732 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9e1a908e-b9f1-4c79-9634-af9b40c113f5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for network, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:09.607732 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9e1a908e-b9f1-4c79-9634-af9b40c113f5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:09.609806 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9e1a908e-b9f1-4c79-9634-af9b40c113f5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:09.678333 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-9e1a908e-b9f1-4c79-9634-af9b40c113f5 admin admin] 10.222.0.37 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.3408647 Nov 08 16:17:09.679515 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 39750) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:17:09.685158 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-fdfc96f8-f2bd-4c0f-b5bc-96fd57568827 admin admin] Request body: {'subnet': {'network_id': '4147c9ec-e793-4b9d-9d14-0919c75accc6', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-292743942-subnet', 'tenant_id': '9aa725833c2f4f209193bd189d5e5828', 'ip_version': 4}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:17:09.687534 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e1a908e-b9f1-4c79-9634-af9b40c113f5 admin admin] Pushing event updated for resources: {'Network': ['ID=4147c9ec-e793-4b9d-9d14-0919c75accc6,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:09.697504 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Network 4147c9ec-e793-4b9d-9d14-0919c75accc6 details requested by agent ovs-agent-dv-cinder-816187-2-iscsi with host dv-cinder-816187-2-iscsi {{(pid=101246) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 16:17:09.715392 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fdfc96f8-f2bd-4c0f-b5bc-96fd57568827 admin admin] Made reservation on behalf of 9aa725833c2f4f209193bd189d5e5828 for: {'subnet': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:17:09.718568 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-fdfc96f8-f2bd-4c0f-b5bc-96fd57568827 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4280170'] for subnet, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:09.919106 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-fdfc96f8-f2bd-4c0f-b5bc-96fd57568827 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-4227723', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4279952'] for subnet, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:09.983235 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdfc96f8-f2bd-4c0f-b5bc-96fd57568827 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ec9f5754-7287-4a31-83db-39c7eedbf104,revision_number=0']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:09.992931 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fdfc96f8-f2bd-4c0f-b5bc-96fd57568827 admin admin] Checking segment: {'id': 'd39e409c-0d63-45bc-961f-deac71fbc480', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 172, 'network_id': '4147c9ec-e793-4b9d-9d14-0919c75accc6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:17:09.993385 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fdfc96f8-f2bd-4c0f-b5bc-96fd57568827 admin admin] Network hostable DHCP agents. Network: 4147c9ec-e793-4b9d-9d14-0919c75accc6, hostable agents: ['a7e1e7ee-1ce2-474e-9688-58f0884991a4'], hosted agents: [] {{(pid=101244) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 16:17:10.013885 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fdfc96f8-f2bd-4c0f-b5bc-96fd57568827 admin admin] Network 4147c9ec-e793-4b9d-9d14-0919c75accc6 is scheduled to be hosted by DHCP agent a7e1e7ee-1ce2-474e-9688-58f0884991a4 with binding_index 1 {{(pid=101244) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 16:17:10.026840 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-fdfc96f8-f2bd-4c0f-b5bc-96fd57568827 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816187-2-iscsi, 4147c9ec-e793-4b9d-9d14-0919c75accc6) {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:17:10.034937 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-732dcdbe-8c89-4b36-84b5-0f328b1a1865 None None] Network 4147c9ec-e793-4b9d-9d14-0919c75accc6 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:17:10.041292 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fdfc96f8-f2bd-4c0f-b5bc-96fd57568827 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:10.042183 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-fdfc96f8-f2bd-4c0f-b5bc-96fd57568827 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for subnet, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:10.067027 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 39784) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:17:10.072042 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-a1ea3969-6aea-4e6b-8e97-7771c80fdfad admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-292743942-router', 'tenant_id': '9aa725833c2f4f209193bd189d5e5828', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:17:10.078715 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-fdfc96f8-f2bd-4c0f-b5bc-96fd57568827 admin admin] 10.222.0.37 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.3977218 Nov 08 16:17:10.106850 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a1ea3969-6aea-4e6b-8e97-7771c80fdfad admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-2034701', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-12912'] for router, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:10.108303 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a1ea3969-6aea-4e6b-8e97-7771c80fdfad admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-2034873', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-2032180', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-2080911', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-12873'] for router, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:10.196538 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d9a1d85-b273-478f-8a3c-914dac7ed187 req-938df158-8cae-497c-bee1-d2f9292cf1b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:10.199318 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1d9a1d85-b273-478f-8a3c-914dac7ed187 req-938df158-8cae-497c-bee1-d2f9292cf1b8 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=10a4252a63bf480d93d2e9da15bb8efd&device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 1098 time: 0.0776455 Nov 08 16:17:10.221554 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a64ab3fd-d907-411a-9a89-159524186fd9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp66bc375f-c06b-591f-b467-1ee6ff0ebcc7-4147c9ec-e793-4b9d-9d14-0919c75accc6', 'network_id': '4147c9ec-e793-4b9d-9d14-0919c75accc6', 'tenant_id': '9aa725833c2f4f209193bd189d5e5828', 'fixed_ips': [{'subnet_id': 'ec9f5754-7287-4a31-83db-39c7eedbf104'}]}} from dv-cinder-816187-2-iscsi. {{(pid=101246) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 08 16:17:10.222684 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-a64ab3fd-d907-411a-9a89-159524186fd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:10.243799 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a1ea3969-6aea-4e6b-8e97-7771c80fdfad admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:10.321265 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d9a1d85-b273-478f-8a3c-914dac7ed187 req-6a7e64f2-87b0-4104-894e-a086b5609f56 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:10.323104 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1d9a1d85-b273-478f-8a3c-914dac7ed187 req-6a7e64f2-87b0-4104-894e-a086b5609f56 service neutron] 10.222.0.25 "GET /v2.0/networks?id=e0e08679-82fe-47eb-90b6-49a1713fdaca HTTP/1.1" status: 200 len: 918 time: 0.1135755 Nov 08 16:17:10.414264 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.db_base_plugin_common [None req-a64ab3fd-d907-411a-9a89-159524186fd9 None None] Allocated IP 172.20.0.2 (4147c9ec-e793-4b9d-9d14-0919c75accc6/ec9f5754-7287-4a31-83db-39c7eedbf104/975890f9-d242-4fbe-b5b7-8cc9601fb0d6) {{(pid=101246) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:17:10.428497 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1d9a1d85-b273-478f-8a3c-914dac7ed187 req-4fb52c76-1d20-4a04-b47f-5924094336d4 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=fbefda08-fc7a-42a0-b714-6dea3d8a5161 HTTP/1.1" status: 200 len: 1001 time: 0.0963244 Nov 08 16:17:10.450029 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5812153-debb-49c1-a421-26bc04fb6684 req-cbde14d8-802c-45a5-bbe1-2ce11e82b52d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:10.451776 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f5812153-debb-49c1-a421-26bc04fb6684 req-cbde14d8-802c-45a5-bbe1-2ce11e82b52d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0750833 Nov 08 16:17:10.455720 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a1ea3969-6aea-4e6b-8e97-7771c80fdfad admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:10.529432 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d9a1d85-b273-478f-8a3c-914dac7ed187 req-b317ced3-4539-4c54-b317-84310bf67f00 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:10.530942 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1d9a1d85-b273-478f-8a3c-914dac7ed187 req-b317ced3-4539-4c54-b317-84310bf67f00 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=fc52ff8b-1692-487b-a0de-f6290e65d880 HTTP/1.1" status: 200 len: 856 time: 0.0895789 Nov 08 16:17:10.574323 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f5812153-debb-49c1-a421-26bc04fb6684 req-3022dfec-e086-40e7-8fbe-c84bc3aa6a7c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1137094 Nov 08 16:17:10.608955 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d9a1d85-b273-478f-8a3c-914dac7ed187 req-c581c962-ab2e-448d-9f25-72b31cc2e453 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:10.611451 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1d9a1d85-b273-478f-8a3c-914dac7ed187 req-c581c962-ab2e-448d-9f25-72b31cc2e453 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=e0e08679-82fe-47eb-90b6-49a1713fdaca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0717425 Nov 08 16:17:10.642154 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ae8055b2-0f1c-40ca-867a-dba92a8e518d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:10.663455 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-a64ab3fd-d907-411a-9a89-159524186fd9 None None] Publish callbacks [] for port, precommit_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:10.670673 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-a64ab3fd-d907-411a-9a89-159524186fd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:10.715821 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1d9a1d85-b273-478f-8a3c-914dac7ed187 req-86f3d266-b007-4ec8-96c2-34539b48ce25 service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0946372 Nov 08 16:17:10.716401 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a1ea3969-6aea-4e6b-8e97-7771c80fdfad admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:10.736231 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a1ea3969-6aea-4e6b-8e97-7771c80fdfad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:10.835408 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a64ab3fd-d907-411a-9a89-159524186fd9 None None] Network 4147c9ec-e793-4b9d-9d14-0919c75accc6 is already hosted by enough agents. {{(pid=101246) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:17:10.837623 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1d9a1d85-b273-478f-8a3c-914dac7ed187 req-693ed6fd-b538-4c70-9ef0-b99f2259775f service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1135957 Nov 08 16:17:10.838499 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.scheduler.base_scheduler [None req-a64ab3fd-d907-411a-9a89-159524186fd9 None None] Resources bound (agent type, host, resource id): {{(pid=101246) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:17:10.844148 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a64ab3fd-d907-411a-9a89-159524186fd9 None None] Received port after_create {{(pid=101246) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:17:10.856592 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a64ab3fd-d907-411a-9a89-159524186fd9 None None] Pushing event updated for resources: {'Port': ['ID=975890f9-d242-4fbe-b5b7-8cc9601fb0d6,revision_number=1']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:10.858003 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_common [None req-a1ea3969-6aea-4e6b-8e97-7771c80fdfad admin admin] Allocated IP 172.27.3.233 (68f46265-b42a-49a0-8d57-f9362045cd9b/4728e4be-5a19-43c0-89cf-ced2a190645d/479982ae-a3e6-4c3a-bef4-83d36603ee76) {{(pid=101245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:17:10.900634 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-a64ab3fd-d907-411a-9a89-159524186fd9 None None] Attempting to bind port 975890f9-d242-4fbe-b5b7-8cc9601fb0d6 on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:17:10.900997 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-a64ab3fd-d907-411a-9a89-159524186fd9 None None] Attempting to bind port 975890f9-d242-4fbe-b5b7-8cc9601fb0d6 by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': 'd39e409c-0d63-45bc-961f-deac71fbc480', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 172, 'network_id': '4147c9ec-e793-4b9d-9d14-0919c75accc6'}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:17:10.901353 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a64ab3fd-d907-411a-9a89-159524186fd9 None None] Attempting to bind port 975890f9-d242-4fbe-b5b7-8cc9601fb0d6 on network 4147c9ec-e793-4b9d-9d14-0919c75accc6 {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:17:10.906348 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a64ab3fd-d907-411a-9a89-159524186fd9 None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 16, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:17:10.906716 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a64ab3fd-d907-411a-9a89-159524186fd9 None None] Checking segment: {'id': 'd39e409c-0d63-45bc-961f-deac71fbc480', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 172, 'network_id': '4147c9ec-e793-4b9d-9d14-0919c75accc6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:17:10.907152 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-a64ab3fd-d907-411a-9a89-159524186fd9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:10.908052 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a64ab3fd-d907-411a-9a89-159524186fd9 None None] Bound using segment: {'id': 'd39e409c-0d63-45bc-961f-deac71fbc480', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 172, 'network_id': '4147c9ec-e793-4b9d-9d14-0919c75accc6'} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:17:10.908504 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-a64ab3fd-d907-411a-9a89-159524186fd9 None None] Bound port: 975890f9-d242-4fbe-b5b7-8cc9601fb0d6, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd39e409c-0d63-45bc-961f-deac71fbc480', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 172, 'network_id': '4147c9ec-e793-4b9d-9d14-0919c75accc6'}}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:17:10.908869 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-a64ab3fd-d907-411a-9a89-159524186fd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:10.966461 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a1ea3969-6aea-4e6b-8e97-7771c80fdfad admin admin] Publish callbacks [] for port, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:10.971335 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-a64ab3fd-d907-411a-9a89-159524186fd9 None None] For port 975890f9-d242-4fbe-b5b7-8cc9601fb0d6, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:17:10.974794 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-a64ab3fd-d907-411a-9a89-159524186fd9 None None] For port 975890f9-d242-4fbe-b5b7-8cc9601fb0d6, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=975890f9-d242-4fbe-b5b7-8cc9601fb0d6,segment=NetworkSegment(d39e409c-0d63-45bc-961f-deac71fbc480),segment_id=d39e409c-0d63-45bc-961f-deac71fbc480)] {{(pid=101246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:17:10.979283 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-a64ab3fd-d907-411a-9a89-159524186fd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:11.005384 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a1ea3969-6aea-4e6b-8e97-7771c80fdfad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:11.045881 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a64ab3fd-d907-411a-9a89-159524186fd9 None None] Pushing event updated for resources: {'Port': ['ID=975890f9-d242-4fbe-b5b7-8cc9601fb0d6,revision_number=2']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:11.060862 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1ea3969-6aea-4e6b-8e97-7771c80fdfad admin admin] Pushing event updated for resources: {'Port': ['ID=479982ae-a3e6-4c3a-bef4-83d36603ee76,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:11.070204 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a1ea3969-6aea-4e6b-8e97-7771c80fdfad admin admin] Network 68f46265-b42a-49a0-8d57-f9362045cd9b is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:17:11.071660 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-a1ea3969-6aea-4e6b-8e97-7771c80fdfad admin admin] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:17:11.074213 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1ea3969-6aea-4e6b-8e97-7771c80fdfad admin admin] Received port after_create {{(pid=101245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:17:11.407745 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] Sync routers for ids ['3aa8420d-7378-4033-af1d-6dae369fd742'] in dv-cinder-816187-2-iscsi {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:17:11.417314 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] Routers {'3aa8420d-7378-4033-af1d-6dae369fd742'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:17:11.417940 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:17:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['3aa8420d-7378-4033-af1d-6dae369fd742'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:17:11.542947 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:11.545770 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] Set router 3aa8420d-7378-4033-af1d-6dae369fd742 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:17:11.582846 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 975890f9-d242-4fbe-b5b7-8cc9601fb0d6 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:17:11.624074 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a1ea3969-6aea-4e6b-8e97-7771c80fdfad admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:11.641113 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 975890f9-d242-4fbe-b5b7-8cc9601fb0d6 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:17:11.641526 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:11.740641 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faa6a98a-929a-45c8-9be9-a3ee495c240a req-0ab30255-7ad7-4dda-b1fa-a5ad665cce4f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:11.742383 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-faa6a98a-929a-45c8-9be9-a3ee495c240a req-0ab30255-7ad7-4dda-b1fa-a5ad665cce4f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0598505 Nov 08 16:17:11.749373 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:11.803244 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'name': 'tempest-TestMinimumBasicScenario-138746869-router', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148'}], 'enable_snat': True}, 'gw_port_id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:17:03Z', 'updated_at': '2021-11-08T16:17:07Z', 'revision_number': 4, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'gw_port': {'id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:1c:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:04Z', 'updated_at': '2021-11-08T16:17:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '1530a0fe-3181-4905-89a0-9606e9ca5a5f', 'name': '', 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'mac_address': 'fa:16:3e:20:1e:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'device_owner': 'network:router_interface', 'standard_attr_id': 479, 'fixed_ips': [{'subnet_id': '12999abd-2828-4905-aed0-938c2f27aed8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:06Z', 'updated_at': '2021-11-08T16:17:07Z', 'revision_number': 2, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'subnets': [{'id': '12999abd-2828-4905-aed0-938c2f27aed8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:17:11.821732 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] For port 975890f9-d242-4fbe-b5b7-8cc9601fb0d6, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=975890f9-d242-4fbe-b5b7-8cc9601fb0d6,segment=NetworkSegment(d39e409c-0d63-45bc-961f-deac71fbc480),segment_id=d39e409c-0d63-45bc-961f-deac71fbc480)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:17:11.835280 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:11.836489 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 67b0adb8-cf59-4b2f-9264-ca9da05f833f up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:17:11.849570 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-faa6a98a-929a-45c8-9be9-a3ee495c240a req-ce722cb9-fe51-4892-92d5-c3faeb1fdea6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0815685 Nov 08 16:17:11.853845 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] Checking router: 3aa8420d-7378-4033-af1d-6dae369fd742 for host: dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:17:11.854384 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] Updating router 3aa8420d-7378-4033-af1d-6dae369fd742 port 1530a0fe-3181-4905-89a0-9606e9ca5a5f binding host dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 16:17:11.893402 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:11.897254 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a1ea3969-6aea-4e6b-8e97-7771c80fdfad admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-2034870', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-2032353'] for router, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:11.943961 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Pushing event updated for resources: {'Port': ['ID=975890f9-d242-4fbe-b5b7-8cc9601fb0d6,revision_number=3']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:11.992973 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 67b0adb8-cf59-4b2f-9264-ca9da05f833f triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:17:11.994087 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:12.047476 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a1ea3969-6aea-4e6b-8e97-7771c80fdfad admin admin] Router 73e4d323-f5da-4144-a58e-cc999a357e1a is scheduled to L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f with binding_index 1 {{(pid=101245) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 08 16:17:12.118663 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:12.149109 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] For port 67b0adb8-cf59-4b2f-9264-ca9da05f833f, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=67b0adb8-cf59-4b2f-9264-ca9da05f833f,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:17:12.154410 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:12.182153 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a1ea3969-6aea-4e6b-8e97-7771c80fdfad admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101245) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:17:12.206993 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a1ea3969-6aea-4e6b-8e97-7771c80fdfad admin admin] Publish callbacks [] for router, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:12.211036 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-a1ea3969-6aea-4e6b-8e97-7771c80fdfad admin admin] 10.222.0.37 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 2.1401768 Nov 08 16:17:12.211180 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 39810) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:17:12.213020 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] Sync routers for ids ['73e4d323-f5da-4144-a58e-cc999a357e1a'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:17:12.219635 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Pushing event updated for resources: {'Port': ['ID=67b0adb8-cf59-4b2f-9264-ca9da05f833f,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:12.234230 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f8ac2d0a-c9e0-481d-ad5e-4c65ace9a1f2 None None] Network 4147c9ec-e793-4b9d-9d14-0919c75accc6 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:17:12.237825 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] Routers {'73e4d323-f5da-4144-a58e-cc999a357e1a'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:17:12.238466 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:17:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['73e4d323-f5da-4144-a58e-cc999a357e1a'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:17:12.270924 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] Publish callbacks [] for port, precommit_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:12.279455 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:12.341508 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0d87de0-b2f0-4c50-8d18-c7f8b4bb19cf None None] Pushing event updated for resources: {'Port': ['ID=1530a0fe-3181-4905-89a0-9606e9ca5a5f,revision_number=3']} {{(pid=101247) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:12.356191 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d87de0-b2f0-4c50-8d18-c7f8b4bb19cf None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:12.356798 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d87de0-b2f0-4c50-8d18-c7f8b4bb19cf None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:12.357997 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d87de0-b2f0-4c50-8d18-c7f8b4bb19cf None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:12.358552 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d87de0-b2f0-4c50-8d18-c7f8b4bb19cf None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:12.358887 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d87de0-b2f0-4c50-8d18-c7f8b4bb19cf None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:12.359274 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d87de0-b2f0-4c50-8d18-c7f8b4bb19cf None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:12.360117 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d87de0-b2f0-4c50-8d18-c7f8b4bb19cf None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:12.360536 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d87de0-b2f0-4c50-8d18-c7f8b4bb19cf None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:12.360892 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d87de0-b2f0-4c50-8d18-c7f8b4bb19cf None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:12.361219 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d87de0-b2f0-4c50-8d18-c7f8b4bb19cf None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:12.361589 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d87de0-b2f0-4c50-8d18-c7f8b4bb19cf None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:12.361956 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0d87de0-b2f0-4c50-8d18-c7f8b4bb19cf None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:12.397695 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-7c9e3f4f-46c6-4193-862d-175b13bb05ca None None] Provisioning complete for port 975890f9-d242-4fbe-b5b7-8cc9601fb0d6 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:17:12.398096 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7c9e3f4f-46c6-4193-862d-175b13bb05ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:12.440997 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] Attempting to bind port 1530a0fe-3181-4905-89a0-9606e9ca5a5f on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:17:12.442682 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] Attempting to bind port 1530a0fe-3181-4905-89a0-9606e9ca5a5f by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': '1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 179, 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837'}] {{(pid=101247) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:17:12.443219 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] Attempting to bind port 1530a0fe-3181-4905-89a0-9606e9ca5a5f on network 52eb1d65-dc7c-45c5-9521-97cb18715837 {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:17:12.449532 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 16, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:17:12.450405 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] Checking segment: {'id': '1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 179, 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101247) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:17:12.450994 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:12.452107 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] Bound using segment: {'id': '1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 179, 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837'} {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:17:12.452738 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] Bound port: 1530a0fe-3181-4905-89a0-9606e9ca5a5f, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 179, 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837'}}] {{(pid=101247) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:17:12.453291 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:12.484237 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] Set router 73e4d323-f5da-4144-a58e-cc999a357e1a gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:17:12.548693 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.db [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] For port 1530a0fe-3181-4905-89a0-9606e9ca5a5f, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101247) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:17:12.552554 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.db [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] For port 1530a0fe-3181-4905-89a0-9606e9ca5a5f, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=1530a0fe-3181-4905-89a0-9606e9ca5a5f,segment=NetworkSegment(1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3),segment_id=1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3)] {{(pid=101247) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:17:12.562838 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:12.661788 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] Routers {'3aa8420d-7378-4033-af1d-6dae369fd742'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:17:12.662433 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:17:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['3aa8420d-7378-4033-af1d-6dae369fd742'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:17:12.711073 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0d87de0-b2f0-4c50-8d18-c7f8b4bb19cf None None] Pushing event updated for resources: {'Port': ['ID=1530a0fe-3181-4905-89a0-9606e9ca5a5f,revision_number=4']} {{(pid=101247) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:12.803533 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73e4d323-f5da-4144-a58e-cc999a357e1a', 'name': 'tempest-TestMinimumBasicScenario-292743942-router', 'tenant_id': '9aa725833c2f4f209193bd189d5e5828', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.233'}], 'enable_snat': True}, 'gw_port_id': '479982ae-a3e6-4c3a-bef4-83d36603ee76', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:17:10Z', 'updated_at': '2021-11-08T16:17:11Z', 'revision_number': 3, 'project_id': '9aa725833c2f4f209193bd189d5e5828', 'gw_port': {'id': '479982ae-a3e6-4c3a-bef4-83d36603ee76', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:10:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73e4d323-f5da-4144-a58e-cc999a357e1a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 495, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:10Z', 'updated_at': '2021-11-08T16:17:10Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:17:12.825375 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] Set router 3aa8420d-7378-4033-af1d-6dae369fd742 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:17:12.837677 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-3df50896-39ce-4a3c-93cd-06fc7477410e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:12.863965 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] Checking router: 73e4d323-f5da-4144-a58e-cc999a357e1a for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:17:12.864462 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] Updating router 73e4d323-f5da-4144-a58e-cc999a357e1a port 479982ae-a3e6-4c3a-bef4-83d36603ee76 binding host dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 16:17:12.898593 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:12.900369 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-d15992ae-726f-4f53-bb9e-10b95bfe40da None None] Provisioning complete for port 1530a0fe-3181-4905-89a0-9606e9ca5a5f triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:17:12.900845 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-d15992ae-726f-4f53-bb9e-10b95bfe40da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:13.077976 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d6a6dc4-e6a0-4bb1-be6e-30c475b9c950 req-f18bd79c-2af9-476a-a38e-81f3e46d5b76 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:13.085113 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8d6a6dc4-e6a0-4bb1-be6e-30c475b9c950 req-f18bd79c-2af9-476a-a38e-81f3e46d5b76 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 945 time: 0.0970538 Nov 08 16:17:13.147878 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-d15992ae-726f-4f53-bb9e-10b95bfe40da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:13.168457 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [None req-3df50896-39ce-4a3c-93cd-06fc7477410e admin admin] Allocated IP 172.20.0.1 (4147c9ec-e793-4b9d-9d14-0919c75accc6/ec9f5754-7287-4a31-83db-39c7eedbf104/63b9282d-3815-4e8c-b7d3-6fa7280c68ed) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:17:13.171451 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'name': 'tempest-TestMinimumBasicScenario-138746869-router', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148'}], 'enable_snat': True}, 'gw_port_id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:17:03Z', 'updated_at': '2021-11-08T16:17:07Z', 'revision_number': 4, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'gw_port': {'id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:1c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:04Z', 'updated_at': '2021-11-08T16:17:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '1530a0fe-3181-4905-89a0-9606e9ca5a5f', 'name': '', 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'mac_address': 'fa:16:3e:20:1e:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'device_owner': 'network:router_interface', 'standard_attr_id': 479, 'fixed_ips': [{'subnet_id': '12999abd-2828-4905-aed0-938c2f27aed8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:06Z', 'updated_at': '2021-11-08T16:17:12Z', 'revision_number': 4, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'subnets': [{'id': '12999abd-2828-4905-aed0-938c2f27aed8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:17:13.177109 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8d6a6dc4-e6a0-4bb1-be6e-30c475b9c950 req-0d9736d7-2b15-4337-b093-4a84ba90ddcf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0911448 Nov 08 16:17:13.211382 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-d15992ae-726f-4f53-bb9e-10b95bfe40da None None] For port 1530a0fe-3181-4905-89a0-9606e9ca5a5f, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=1530a0fe-3181-4905-89a0-9606e9ca5a5f,segment=NetworkSegment(1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3),segment_id=1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:17:13.217627 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60785255-054f-43ff-b4d9-7ca039fb90b8 None None] The sync data for ids ['3aa8420d-7378-4033-af1d-6dae369fd742'] in dv-cinder-816187-2-iscsi is: [{'id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'name': 'tempest-TestMinimumBasicScenario-138746869-router', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148'}], 'enable_snat': True}, 'gw_port_id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:17:03Z', 'updated_at': '2021-11-08T16:17:07Z', 'revision_number': 4, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'gw_port': {'id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:1c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:04Z', 'updated_at': '2021-11-08T16:17:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '1530a0fe-3181-4905-89a0-9606e9ca5a5f', 'name': '', 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'mac_address': 'fa:16:3e:20:1e:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'device_owner': 'network:router_interface', 'standard_attr_id': 479, 'fixed_ips': [{'subnet_id': '12999abd-2828-4905-aed0-938c2f27aed8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:06Z', 'updated_at': '2021-11-08T16:17:12Z', 'revision_number': 4, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'subnets': [{'id': '12999abd-2828-4905-aed0-938c2f27aed8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:17:13.233596 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-d15992ae-726f-4f53-bb9e-10b95bfe40da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:13.313746 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-3df50896-39ce-4a3c-93cd-06fc7477410e admin admin] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:13.339879 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:13.358873 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-3df50896-39ce-4a3c-93cd-06fc7477410e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:13.372377 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] Publish callbacks [] for port, precommit_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:13.376442 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d15992ae-726f-4f53-bb9e-10b95bfe40da None None] Pushing event updated for resources: {'Port': ['ID=1530a0fe-3181-4905-89a0-9606e9ca5a5f,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:13.384460 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:13.411851 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3df50896-39ce-4a3c-93cd-06fc7477410e admin admin] Network 4147c9ec-e793-4b9d-9d14-0919c75accc6 is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:17:13.415430 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-3df50896-39ce-4a3c-93cd-06fc7477410e admin admin] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:17:13.420355 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3df50896-39ce-4a3c-93cd-06fc7477410e admin admin] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:17:13.493787 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-3df50896-39ce-4a3c-93cd-06fc7477410e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-2033204'] for router_interface, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:13.505044 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3df50896-39ce-4a3c-93cd-06fc7477410e admin admin] Pushing event updated for resources: {'Port': ['ID=63b9282d-3815-4e8c-b7d3-6fa7280c68ed,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:13.591138 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cd36421a-b952-4d3c-9181-6f3ff75d460d None None] Provisioning complete for port 975890f9-d242-4fbe-b5b7-8cc9601fb0d6 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:17:13.591138 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cd36421a-b952-4d3c-9181-6f3ff75d460d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:13.639945 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] Attempting to bind port 479982ae-a3e6-4c3a-bef4-83d36603ee76 on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:17:13.640610 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] Attempting to bind port 479982ae-a3e6-4c3a-bef4-83d36603ee76 by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:17:13.640610 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] Attempting to bind port 479982ae-a3e6-4c3a-bef4-83d36603ee76 on network 68f46265-b42a-49a0-8d57-f9362045cd9b {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:17:13.652212 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1f6772f-fa18-413d-9910-0517fa6b9c28 None None] Pushing event updated for resources: {'Port': ['ID=479982ae-a3e6-4c3a-bef4-83d36603ee76,revision_number=2']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:13.661582 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device fbefda08-fc7a-42a0-b714-6dea3d8a5161 no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:17:13.671024 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 16, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:17:13.671317 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] Checking segment: {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:17:13.671632 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:13.672027 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] Bound using segment: {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:17:13.672512 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] Bound port: 479982ae-a3e6-4c3a-bef4-83d36603ee76, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:17:13.673456 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:13.720878 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 1530a0fe-3181-4905-89a0-9606e9ca5a5f up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:17:13.820858 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] For port 479982ae-a3e6-4c3a-bef4-83d36603ee76, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:17:13.829422 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] For port 479982ae-a3e6-4c3a-bef4-83d36603ee76, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=479982ae-a3e6-4c3a-bef4-83d36603ee76,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:17:13.875100 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:13.948106 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 1530a0fe-3181-4905-89a0-9606e9ca5a5f triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:17:13.948483 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:13.960135 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:14.031783 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] Routers {'73e4d323-f5da-4144-a58e-cc999a357e1a'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:17:14.033118 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:17:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['73e4d323-f5da-4144-a58e-cc999a357e1a'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:17:14.044174 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1f6772f-fa18-413d-9910-0517fa6b9c28 None None] Pushing event updated for resources: {'Port': ['ID=479982ae-a3e6-4c3a-bef4-83d36603ee76,revision_number=3']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:14.072617 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-3df50896-39ce-4a3c-93cd-06fc7477410e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:14.085215 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:14.094875 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c1c8c8d-5f78-45fb-803d-8f7a84df3433', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'fbefda08-fc7a-42a0-b714-6dea3d8a5161'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:17:14.097139 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8ae4e869-21f2-4125-8c97-7ec92faa6dc4" -d '{"events": [{"server_uuid": "1c1c8c8d-5f78-45fb-803d-8f7a84df3433", "name": "network-vif-unplugged", "status": "completed", "tag": "fbefda08-fc7a-42a0-b714-6dea3d8a5161"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:17:14.128145 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cd36421a-b952-4d3c-9181-6f3ff75d460d None None] Provisioning complete for port 1530a0fe-3181-4905-89a0-9606e9ca5a5f triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:17:14.128358 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cd36421a-b952-4d3c-9181-6f3ff75d460d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:14.139296 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port fbefda08-fc7a-42a0-b714-6dea3d8a5161, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=fbefda08-fc7a-42a0-b714-6dea3d8a5161,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:17:14.171919 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [req-1ec0a356-9386-49c6-b99f-fbe56ea50872 req-17818117-1998-4cbb-9a59-d441ebbdf0a7 service neutron] http://10.222.0.37:9696/v2.0/extensions returned with HTTP 200 {{(pid=101244) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 16:17:14.174003 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1ec0a356-9386-49c6-b99f-fbe56ea50872 req-17818117-1998-4cbb-9a59-d441ebbdf0a7 service neutron] 10.222.0.37 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1693137 Nov 08 16:17:14.183813 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:14.326706 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-3df50896-39ce-4a3c-93cd-06fc7477410e admin admin] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:14.335362 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-3df50896-39ce-4a3c-93cd-06fc7477410e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:14.401019 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] Set router 73e4d323-f5da-4144-a58e-cc999a357e1a gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:17:14.408144 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 975890f9-d242-4fbe-b5b7-8cc9601fb0d6 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:17:14.453196 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3df50896-39ce-4a3c-93cd-06fc7477410e admin admin] Pushing event updated for resources: {'Port': ['ID=63b9282d-3815-4e8c-b7d3-6fa7280c68ed,revision_number=2']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:14.456981 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-3df50896-39ce-4a3c-93cd-06fc7477410e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1599525', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-2033312'] for router_interface, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:14.487149 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Mon, 08 Nov 2021 16:17:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a184ea20-3b11-424e-ad70-d112dff551a5 x-openstack-request-id: req-a184ea20-3b11-424e-ad70-d112dff551a5 {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:17:14.487465 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1c1c8c8d-5f78-45fb-803d-8f7a84df3433", "name": "network-vif-unplugged", "status": "failed", "tag": "fbefda08-fc7a-42a0-b714-6dea3d8a5161", "code": 422}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:17:14.487695 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-a184ea20-3b11-424e-ad70-d112dff551a5 {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:17:14.488107 dv-cinder-816187-2-iscsi neutron-server[101246]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '1c1c8c8d-5f78-45fb-803d-8f7a84df3433', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'fbefda08-fc7a-42a0-b714-6dea3d8a5161', 'code': 422} returned with failed status Nov 08 16:17:14.500293 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=fbefda08-fc7a-42a0-b714-6dea3d8a5161,revision_number=8']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:14.545135 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f55417e2-ac1d-4f65-8c37-be19eefb78b2 req-976c4980-0977-410f-89b7-63d2594f9af0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:14.546682 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f55417e2-ac1d-4f65-8c37-be19eefb78b2 req-976c4980-0977-410f-89b7-63d2594f9af0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.2071948 Nov 08 16:17:14.630464 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f55417e2-ac1d-4f65-8c37-be19eefb78b2 req-3ec544a5-9f24-49de-8ef3-aabe44441973 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0756207 Nov 08 16:17:14.639069 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 975890f9-d242-4fbe-b5b7-8cc9601fb0d6 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:17:14.639226 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3df50896-39ce-4a3c-93cd-06fc7477410e admin admin] Network 4147c9ec-e793-4b9d-9d14-0919c75accc6 is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:17:14.639434 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:14.640594 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-3df50896-39ce-4a3c-93cd-06fc7477410e admin admin] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:17:14.703797 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 39862) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:17:14.799536 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3df50896-39ce-4a3c-93cd-06fc7477410e admin admin] Router 73e4d323-f5da-4144-a58e-cc999a357e1a has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:17:14.799973 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-b54c40d9-0edc-4044-b978-5ef53dff5777 None None] Provisioning complete for port 63b9282d-3815-4e8c-b7d3-6fa7280c68ed triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:17:14.800248 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-b54c40d9-0edc-4044-b978-5ef53dff5777 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:14.853500 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 67b0adb8-cf59-4b2f-9264-ca9da05f833f up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:17:14.875534 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-b54c40d9-0edc-4044-b978-5ef53dff5777 None None] Port 63b9282d-3815-4e8c-b7d3-6fa7280c68ed cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:17:14.880811 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-30f40d24-b2de-4f04-913e-65a2494d3dc8 req-e982fbbf-3f5c-411b-9e71-51cf80a1dba8 service neutron] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1755869 Nov 08 16:17:14.898343 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [req-30f40d24-b2de-4f04-913e-65a2494d3dc8 req-71726542-3491-4347-9e32-455ce647051c service neutron] http://10.222.0.37:9696/v2.0/extensions returned with HTTP 200 {{(pid=101244) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 16:17:14.899418 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-30f40d24-b2de-4f04-913e-65a2494d3dc8 req-71726542-3491-4347-9e32-455ce647051c service neutron] 10.222.0.37 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0055630 Nov 08 16:17:14.925154 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73e4d323-f5da-4144-a58e-cc999a357e1a', 'name': 'tempest-TestMinimumBasicScenario-292743942-router', 'tenant_id': '9aa725833c2f4f209193bd189d5e5828', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.233'}], 'enable_snat': True}, 'gw_port_id': '479982ae-a3e6-4c3a-bef4-83d36603ee76', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:17:10Z', 'updated_at': '2021-11-08T16:17:14Z', 'revision_number': 4, 'project_id': '9aa725833c2f4f209193bd189d5e5828', 'gw_port': {'id': '479982ae-a3e6-4c3a-bef4-83d36603ee76', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:10:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73e4d323-f5da-4144-a58e-cc999a357e1a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 495, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:10Z', 'updated_at': '2021-11-08T16:17:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '63b9282d-3815-4e8c-b7d3-6fa7280c68ed', 'name': '', 'network_id': '4147c9ec-e793-4b9d-9d14-0919c75accc6', 'tenant_id': '9aa725833c2f4f209193bd189d5e5828', 'mac_address': 'fa:16:3e:51:ea:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73e4d323-f5da-4144-a58e-cc999a357e1a', 'device_owner': 'network:router_interface', 'standard_attr_id': 496, 'fixed_ips': [{'subnet_id': 'ec9f5754-7287-4a31-83db-39c7eedbf104', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:12Z', 'updated_at': '2021-11-08T16:17:13Z', 'revision_number': 1, 'project_id': '9aa725833c2f4f209193bd189d5e5828', 'subnets': [{'id': 'ec9f5754-7287-4a31-83db-39c7eedbf104', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:17:14.961753 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26c4cca7-eece-478f-9f86-328c754bf693 None None] The sync data for ids ['73e4d323-f5da-4144-a58e-cc999a357e1a'] in dv-cinder-816187-2-iscsi is: [{'id': '73e4d323-f5da-4144-a58e-cc999a357e1a', 'name': 'tempest-TestMinimumBasicScenario-292743942-router', 'tenant_id': '9aa725833c2f4f209193bd189d5e5828', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.233'}], 'enable_snat': True}, 'gw_port_id': '479982ae-a3e6-4c3a-bef4-83d36603ee76', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:17:10Z', 'updated_at': '2021-11-08T16:17:14Z', 'revision_number': 4, 'project_id': '9aa725833c2f4f209193bd189d5e5828', 'gw_port': {'id': '479982ae-a3e6-4c3a-bef4-83d36603ee76', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:10:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73e4d323-f5da-4144-a58e-cc999a357e1a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 495, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:10Z', 'updated_at': '2021-11-08T16:17:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '63b9282d-3815-4e8c-b7d3-6fa7280c68ed', 'name': '', 'network_id': '4147c9ec-e793-4b9d-9d14-0919c75accc6', 'tenant_id': '9aa725833c2f4f209193bd189d5e5828', 'mac_address': 'fa:16:3e:51:ea:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73e4d323-f5da-4144-a58e-cc999a357e1a', 'device_owner': 'network:router_interface', 'standard_attr_id': 496, 'fixed_ips': [{'subnet_id': 'ec9f5754-7287-4a31-83db-39c7eedbf104', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:12Z', 'updated_at': '2021-11-08T16:17:13Z', 'revision_number': 1, 'project_id': '9aa725833c2f4f209193bd189d5e5828', 'subnets': [{'id': 'ec9f5754-7287-4a31-83db-39c7eedbf104', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:17:14.964216 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 67b0adb8-cf59-4b2f-9264-ca9da05f833f triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:17:14.964583 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:14.970792 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3df50896-39ce-4a3c-93cd-06fc7477410e admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:17:14.986626 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-3df50896-39ce-4a3c-93cd-06fc7477410e admin admin] 10.222.0.37 "PUT /v2.0/routers/73e4d323-f5da-4144-a58e-cc999a357e1a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7643743 Nov 08 16:17:15.018528 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-9c21dca1-5ec3-46e3-8f51-c5b2ebb26836 None None] Provisioning complete for port 63b9282d-3815-4e8c-b7d3-6fa7280c68ed triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:17:15.018895 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-9c21dca1-5ec3-46e3-8f51-c5b2ebb26836 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:15.086337 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-9c21dca1-5ec3-46e3-8f51-c5b2ebb26836 None None] Port 63b9282d-3815-4e8c-b7d3-6fa7280c68ed cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:17:15.811999 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b670c24-b983-4fbe-86b7-96f10ce90b3a req-e9eeee42-3afb-4cfd-bb1e-62c94548df32 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:15.821750 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5b670c24-b983-4fbe-86b7-96f10ce90b3a req-e9eeee42-3afb-4cfd-bb1e-62c94548df32 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0714865 Nov 08 16:17:15.923214 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5b670c24-b983-4fbe-86b7-96f10ce90b3a req-7425af05-6274-4f42-b8f1-ef189f6b115d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1004333 Nov 08 16:17:17.055150 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30f40d24-b2de-4f04-913e-65a2494d3dc8 req-79d332cf-127b-450b-a8ec-dfbaa52a5f4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:17.057368 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-30f40d24-b2de-4f04-913e-65a2494d3dc8 req-79d332cf-127b-450b-a8ec-dfbaa52a5f4e service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433&tenant_id=10a4252a63bf480d93d2e9da15bb8efd HTTP/1.1" status: 200 len: 1096 time: 0.1082602 Nov 08 16:17:17.090630 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a8f1674-0cde-484d-a2c5-1139df20a124 req-be6e2d54-4dd4-446e-a0a8-3ccb43844539 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:17.098480 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9a8f1674-0cde-484d-a2c5-1139df20a124 req-be6e2d54-4dd4-446e-a0a8-3ccb43844539 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0886762 Nov 08 16:17:17.185371 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9a8f1674-0cde-484d-a2c5-1139df20a124 req-c7afbc66-ea7e-492b-821e-d49809c49b85 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0859051 Nov 08 16:17:17.195239 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30f40d24-b2de-4f04-913e-65a2494d3dc8 req-25565bae-5962-4277-be08-4802011968a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:17.197761 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-30f40d24-b2de-4f04-913e-65a2494d3dc8 req-25565bae-5962-4277-be08-4802011968a0 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=10a4252a63bf480d93d2e9da15bb8efd&device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 1096 time: 0.0949588 Nov 08 16:17:17.338769 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30f40d24-b2de-4f04-913e-65a2494d3dc8 req-e03ba23a-3245-4b11-b3c2-d7d353a1ff85 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:17.340721 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-30f40d24-b2de-4f04-913e-65a2494d3dc8 req-e03ba23a-3245-4b11-b3c2-d7d353a1ff85 service neutron] 10.222.0.25 "GET /v2.0/networks?id=e0e08679-82fe-47eb-90b6-49a1713fdaca HTTP/1.1" status: 200 len: 918 time: 0.1359856 Nov 08 16:17:17.419976 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-30f40d24-b2de-4f04-913e-65a2494d3dc8 req-cd19eabe-7200-4e00-9853-eb2059fe1fe2 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=fbefda08-fc7a-42a0-b714-6dea3d8a5161 HTTP/1.1" status: 200 len: 999 time: 0.0683997 Nov 08 16:17:17.485670 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30f40d24-b2de-4f04-913e-65a2494d3dc8 req-5e55c611-0a06-4bc7-aa27-090807d9959e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:17.487760 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-30f40d24-b2de-4f04-913e-65a2494d3dc8 req-5e55c611-0a06-4bc7-aa27-090807d9959e service neutron] 10.222.0.25 "GET /v2.0/subnets?id=fc52ff8b-1692-487b-a0de-f6290e65d880 HTTP/1.1" status: 200 len: 856 time: 0.0614145 Nov 08 16:17:17.520248 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] Sync routers for ids ['73e4d323-f5da-4144-a58e-cc999a357e1a'] in dv-cinder-816187-2-iscsi {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:17:17.530094 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] Routers {'73e4d323-f5da-4144-a58e-cc999a357e1a'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:17:17.530691 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:17:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['73e4d323-f5da-4144-a58e-cc999a357e1a'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:17:17.562682 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30f40d24-b2de-4f04-913e-65a2494d3dc8 req-26b08435-fa12-4465-bfaf-1a9cb466c208 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:17.564752 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-30f40d24-b2de-4f04-913e-65a2494d3dc8 req-26b08435-fa12-4465-bfaf-1a9cb466c208 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=e0e08679-82fe-47eb-90b6-49a1713fdaca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0695326 Nov 08 16:17:17.568279 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 479982ae-a3e6-4c3a-bef4-83d36603ee76 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:17:17.674111 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] Set router 73e4d323-f5da-4144-a58e-cc999a357e1a gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:17:17.693091 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 479982ae-a3e6-4c3a-bef4-83d36603ee76 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:17:17.693931 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:17.737955 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-30f40d24-b2de-4f04-913e-65a2494d3dc8 req-044df188-02de-46c8-aa57-4b2e2f0f5e1d service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1569576 Nov 08 16:17:17.777110 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:17.805356 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] For port 479982ae-a3e6-4c3a-bef4-83d36603ee76, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=479982ae-a3e6-4c3a-bef4-83d36603ee76,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:17:17.816057 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:17.885357 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-30f40d24-b2de-4f04-913e-65a2494d3dc8 req-2fd9e11f-a2df-46c9-87a3-3eb1abd526e2 service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1281917 Nov 08 16:17:17.894652 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Pushing event updated for resources: {'Port': ['ID=479982ae-a3e6-4c3a-bef4-83d36603ee76,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:17.945882 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:18.009356 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73e4d323-f5da-4144-a58e-cc999a357e1a', 'name': 'tempest-TestMinimumBasicScenario-292743942-router', 'tenant_id': '9aa725833c2f4f209193bd189d5e5828', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.233'}], 'enable_snat': True}, 'gw_port_id': '479982ae-a3e6-4c3a-bef4-83d36603ee76', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:17:10Z', 'updated_at': '2021-11-08T16:17:14Z', 'revision_number': 4, 'project_id': '9aa725833c2f4f209193bd189d5e5828', 'gw_port': {'id': '479982ae-a3e6-4c3a-bef4-83d36603ee76', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:10:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73e4d323-f5da-4144-a58e-cc999a357e1a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 495, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:10Z', 'updated_at': '2021-11-08T16:17:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '63b9282d-3815-4e8c-b7d3-6fa7280c68ed', 'name': '', 'network_id': '4147c9ec-e793-4b9d-9d14-0919c75accc6', 'tenant_id': '9aa725833c2f4f209193bd189d5e5828', 'mac_address': 'fa:16:3e:51:ea:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73e4d323-f5da-4144-a58e-cc999a357e1a', 'device_owner': 'network:router_interface', 'standard_attr_id': 496, 'fixed_ips': [{'subnet_id': 'ec9f5754-7287-4a31-83db-39c7eedbf104', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:12Z', 'updated_at': '2021-11-08T16:17:14Z', 'revision_number': 2, 'project_id': '9aa725833c2f4f209193bd189d5e5828', 'subnets': [{'id': 'ec9f5754-7287-4a31-83db-39c7eedbf104', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:17:18.040487 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5759bec2-53ab-473d-9955-2831f64e7a5a req-b43d61a7-5091-40c9-8507-e6ef08558965 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:18.041636 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] Checking router: 73e4d323-f5da-4144-a58e-cc999a357e1a for host: dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:17:18.042040 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5759bec2-53ab-473d-9955-2831f64e7a5a req-b43d61a7-5091-40c9-8507-e6ef08558965 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=10a4252a63bf480d93d2e9da15bb8efd&device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 1096 time: 0.0515857 Nov 08 16:17:18.042482 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] Updating router 73e4d323-f5da-4144-a58e-cc999a357e1a port 63b9282d-3815-4e8c-b7d3-6fa7280c68ed binding host dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 16:17:18.073017 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:18.179040 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5759bec2-53ab-473d-9955-2831f64e7a5a req-3182e60a-6c42-4916-9a28-2de2ed49915b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:18.180541 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5759bec2-53ab-473d-9955-2831f64e7a5a req-3182e60a-6c42-4916-9a28-2de2ed49915b service neutron] 10.222.0.25 "GET /v2.0/networks?id=e0e08679-82fe-47eb-90b6-49a1713fdaca HTTP/1.1" status: 200 len: 918 time: 0.1106060 Nov 08 16:17:18.265003 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5759bec2-53ab-473d-9955-2831f64e7a5a req-612e18f3-4a71-4703-bb97-dffd5b8d80b4 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=fbefda08-fc7a-42a0-b714-6dea3d8a5161 HTTP/1.1" status: 200 len: 999 time: 0.0757849 Nov 08 16:17:18.340598 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5759bec2-53ab-473d-9955-2831f64e7a5a req-95443ed5-f10e-427c-8b66-cba567010ddf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:18.342740 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5759bec2-53ab-473d-9955-2831f64e7a5a req-95443ed5-f10e-427c-8b66-cba567010ddf service neutron] 10.222.0.25 "GET /v2.0/subnets?id=fc52ff8b-1692-487b-a0de-f6290e65d880 HTTP/1.1" status: 200 len: 856 time: 0.0700514 Nov 08 16:17:18.414420 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] Publish callbacks [] for port, precommit_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:18.425010 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:18.431993 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ea3b2de-e08e-4acc-8442-84b47df86394 req-71aa2daf-c637-49f6-b61a-f151400f9ec5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:18.446556 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6ea3b2de-e08e-4acc-8442-84b47df86394 req-71aa2daf-c637-49f6-b61a-f151400f9ec5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0979013 Nov 08 16:17:18.459595 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5759bec2-53ab-473d-9955-2831f64e7a5a req-0d57668c-5be3-4b35-bfc7-1edfe08a6154 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:18.461206 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5759bec2-53ab-473d-9955-2831f64e7a5a req-0d57668c-5be3-4b35-bfc7-1edfe08a6154 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=e0e08679-82fe-47eb-90b6-49a1713fdaca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1036527 Nov 08 16:17:18.477669 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35b210af-e4a9-4383-960b-1e95730c7e48 None None] Pushing event updated for resources: {'Port': ['ID=63b9282d-3815-4e8c-b7d3-6fa7280c68ed,revision_number=3']} {{(pid=101247) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:18.578978 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] Attempting to bind port 63b9282d-3815-4e8c-b7d3-6fa7280c68ed on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:17:18.579654 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] Attempting to bind port 63b9282d-3815-4e8c-b7d3-6fa7280c68ed by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': 'd39e409c-0d63-45bc-961f-deac71fbc480', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 172, 'network_id': '4147c9ec-e793-4b9d-9d14-0919c75accc6'}] {{(pid=101247) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:17:18.579901 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] Attempting to bind port 63b9282d-3815-4e8c-b7d3-6fa7280c68ed on network 4147c9ec-e793-4b9d-9d14-0919c75accc6 {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:17:18.597360 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 17, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:17:18.597926 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] Checking segment: {'id': 'd39e409c-0d63-45bc-961f-deac71fbc480', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 172, 'network_id': '4147c9ec-e793-4b9d-9d14-0919c75accc6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101247) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:17:18.598413 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:18.598896 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] Bound using segment: {'id': 'd39e409c-0d63-45bc-961f-deac71fbc480', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 172, 'network_id': '4147c9ec-e793-4b9d-9d14-0919c75accc6'} {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:17:18.599466 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] Bound port: 63b9282d-3815-4e8c-b7d3-6fa7280c68ed, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd39e409c-0d63-45bc-961f-deac71fbc480', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 172, 'network_id': '4147c9ec-e793-4b9d-9d14-0919c75accc6'}}] {{(pid=101247) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:17:18.599945 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:18.611415 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6ea3b2de-e08e-4acc-8442-84b47df86394 req-e8736cb0-eedd-4bdd-8966-72e803921b18 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1637759 Nov 08 16:17:18.683686 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5759bec2-53ab-473d-9955-2831f64e7a5a req-086fb77f-a5fe-437f-90f1-89e868033086 service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2034364 Nov 08 16:17:18.726214 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.db [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] For port 63b9282d-3815-4e8c-b7d3-6fa7280c68ed, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101247) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:17:18.729598 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.db [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] For port 63b9282d-3815-4e8c-b7d3-6fa7280c68ed, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=63b9282d-3815-4e8c-b7d3-6fa7280c68ed,segment=NetworkSegment(d39e409c-0d63-45bc-961f-deac71fbc480),segment_id=d39e409c-0d63-45bc-961f-deac71fbc480)] {{(pid=101247) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:17:18.740434 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:18.804376 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35b210af-e4a9-4383-960b-1e95730c7e48 None None] Pushing event updated for resources: {'Port': ['ID=63b9282d-3815-4e8c-b7d3-6fa7280c68ed,revision_number=4']} {{(pid=101247) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:18.839182 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] Routers {'73e4d323-f5da-4144-a58e-cc999a357e1a'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:17:18.841095 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:17:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['73e4d323-f5da-4144-a58e-cc999a357e1a'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:17:18.865310 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5759bec2-53ab-473d-9955-2831f64e7a5a req-bfb8cc4d-4e5f-4268-a38e-4178351ad289 service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1686926 Nov 08 16:17:18.906305 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-c6f47899-1807-49b3-8c03-a0a9ad4cd1f3 None None] Provisioning complete for port 63b9282d-3815-4e8c-b7d3-6fa7280c68ed triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:17:18.908239 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-c6f47899-1807-49b3-8c03-a0a9ad4cd1f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:18.997097 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-c6f47899-1807-49b3-8c03-a0a9ad4cd1f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:19.023895 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] Set router 73e4d323-f5da-4144-a58e-cc999a357e1a gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:17:19.082558 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-c6f47899-1807-49b3-8c03-a0a9ad4cd1f3 None None] For port 63b9282d-3815-4e8c-b7d3-6fa7280c68ed, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=63b9282d-3815-4e8c-b7d3-6fa7280c68ed,segment=NetworkSegment(d39e409c-0d63-45bc-961f-deac71fbc480),segment_id=d39e409c-0d63-45bc-961f-deac71fbc480)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:17:19.110471 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-c6f47899-1807-49b3-8c03-a0a9ad4cd1f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:19.315877 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6f47899-1807-49b3-8c03-a0a9ad4cd1f3 None None] Pushing event updated for resources: {'Port': ['ID=63b9282d-3815-4e8c-b7d3-6fa7280c68ed,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:19.333889 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6da5c53b-70b1-4e2d-b99e-e7fa6084097f None None] Provisioning complete for port 63b9282d-3815-4e8c-b7d3-6fa7280c68ed triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:17:19.335347 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6da5c53b-70b1-4e2d-b99e-e7fa6084097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:19.339019 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73e4d323-f5da-4144-a58e-cc999a357e1a', 'name': 'tempest-TestMinimumBasicScenario-292743942-router', 'tenant_id': '9aa725833c2f4f209193bd189d5e5828', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.233'}], 'enable_snat': True}, 'gw_port_id': '479982ae-a3e6-4c3a-bef4-83d36603ee76', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:17:10Z', 'updated_at': '2021-11-08T16:17:14Z', 'revision_number': 4, 'project_id': '9aa725833c2f4f209193bd189d5e5828', 'gw_port': {'id': '479982ae-a3e6-4c3a-bef4-83d36603ee76', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:10:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73e4d323-f5da-4144-a58e-cc999a357e1a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 495, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:10Z', 'updated_at': '2021-11-08T16:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '63b9282d-3815-4e8c-b7d3-6fa7280c68ed', 'name': '', 'network_id': '4147c9ec-e793-4b9d-9d14-0919c75accc6', 'tenant_id': '9aa725833c2f4f209193bd189d5e5828', 'mac_address': 'fa:16:3e:51:ea:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73e4d323-f5da-4144-a58e-cc999a357e1a', 'device_owner': 'network:router_interface', 'standard_attr_id': 496, 'fixed_ips': [{'subnet_id': 'ec9f5754-7287-4a31-83db-39c7eedbf104', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:12Z', 'updated_at': '2021-11-08T16:17:18Z', 'revision_number': 4, 'project_id': '9aa725833c2f4f209193bd189d5e5828', 'subnets': [{'id': 'ec9f5754-7287-4a31-83db-39c7eedbf104', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:17:19.373014 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec713726-2a7f-4b9e-b33d-30db10895186 None None] The sync data for ids ['73e4d323-f5da-4144-a58e-cc999a357e1a'] in dv-cinder-816187-2-iscsi is: [{'id': '73e4d323-f5da-4144-a58e-cc999a357e1a', 'name': 'tempest-TestMinimumBasicScenario-292743942-router', 'tenant_id': '9aa725833c2f4f209193bd189d5e5828', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.233'}], 'enable_snat': True}, 'gw_port_id': '479982ae-a3e6-4c3a-bef4-83d36603ee76', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:17:10Z', 'updated_at': '2021-11-08T16:17:14Z', 'revision_number': 4, 'project_id': '9aa725833c2f4f209193bd189d5e5828', 'gw_port': {'id': '479982ae-a3e6-4c3a-bef4-83d36603ee76', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:10:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73e4d323-f5da-4144-a58e-cc999a357e1a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 495, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:10Z', 'updated_at': '2021-11-08T16:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '63b9282d-3815-4e8c-b7d3-6fa7280c68ed', 'name': '', 'network_id': '4147c9ec-e793-4b9d-9d14-0919c75accc6', 'tenant_id': '9aa725833c2f4f209193bd189d5e5828', 'mac_address': 'fa:16:3e:51:ea:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73e4d323-f5da-4144-a58e-cc999a357e1a', 'device_owner': 'network:router_interface', 'standard_attr_id': 496, 'fixed_ips': [{'subnet_id': 'ec9f5754-7287-4a31-83db-39c7eedbf104', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:12Z', 'updated_at': '2021-11-08T16:17:18Z', 'revision_number': 4, 'project_id': '9aa725833c2f4f209193bd189d5e5828', 'subnets': [{'id': 'ec9f5754-7287-4a31-83db-39c7eedbf104', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:17:19.604992 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 479982ae-a3e6-4c3a-bef4-83d36603ee76 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:17:19.724472 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 479982ae-a3e6-4c3a-bef4-83d36603ee76 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:17:19.724936 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:19.887613 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 63b9282d-3815-4e8c-b7d3-6fa7280c68ed up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:17:19.979737 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 63b9282d-3815-4e8c-b7d3-6fa7280c68ed triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:17:19.980963 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:19.996307 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-371c5a09-da36-449d-977a-34206154722c req-d5b68cb3-2eb5-4509-8fe0-a07a72488a53 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:20.004279 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-371c5a09-da36-449d-977a-34206154722c req-d5b68cb3-2eb5-4509-8fe0-a07a72488a53 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0652523 Nov 08 16:17:20.095607 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-371c5a09-da36-449d-977a-34206154722c req-ddbaef62-61bb-474a-b970-8612a434d261 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0902557 Nov 08 16:17:21.235060 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-329b9bf3-38e7-4e9f-a153-64a2906fca8e req-8123c197-3be6-4fd7-b179-d740cfd48a4a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:21.238443 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-329b9bf3-38e7-4e9f-a153-64a2906fca8e req-8123c197-3be6-4fd7-b179-d740cfd48a4a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0626843 Nov 08 16:17:21.294412 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-329b9bf3-38e7-4e9f-a153-64a2906fca8e req-ae806796-dbac-4d45-b192-cf516abe4a5a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0507474 Nov 08 16:17:22.454916 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e44b91d-c15b-47f0-9795-5bab44a29322 req-da99c19e-7881-47d3-b251-e1533a5cd0df tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:22.456606 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3e44b91d-c15b-47f0-9795-5bab44a29322 req-da99c19e-7881-47d3-b251-e1533a5cd0df tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0657034 Nov 08 16:17:22.532311 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3e44b91d-c15b-47f0-9795-5bab44a29322 req-7cb6d9c0-f566-4c28-ba62-13e6168c931a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0651789 Nov 08 16:17:23.652301 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f2be6fc-df93-4aa4-8d2c-e6f644e7c275 req-75ab8b77-c79b-4f02-a355-fc3ae79f4510 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:23.654750 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0f2be6fc-df93-4aa4-8d2c-e6f644e7c275 req-75ab8b77-c79b-4f02-a355-fc3ae79f4510 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0532963 Nov 08 16:17:23.726316 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0f2be6fc-df93-4aa4-8d2c-e6f644e7c275 req-4ba50ef5-c39c-433a-9549-0d22c6aa7b97 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0657909 Nov 08 16:17:24.910741 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b80e562f-a7e6-4b5c-a016-f05973aec4ca req-434234cd-9819-4a40-b41c-48d27716f293 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:24.926788 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b80e562f-a7e6-4b5c-a016-f05973aec4ca req-434234cd-9819-4a40-b41c-48d27716f293 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0984433 Nov 08 16:17:25.010626 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b80e562f-a7e6-4b5c-a016-f05973aec4ca req-0f567d8a-6ad0-4880-89f2-66bce03c6b95 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0868270 Nov 08 16:17:26.208785 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7faea5c1-6cc8-4fca-ab60-0a2b6583fef7 req-36b7c43c-153f-4ac6-a82d-db6f28b346f4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:26.210295 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7faea5c1-6cc8-4fca-ab60-0a2b6583fef7 req-36b7c43c-153f-4ac6-a82d-db6f28b346f4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.1257179 Nov 08 16:17:26.236189 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a75dde96-b2a6-4804-b566-165b576626ff req-1e2af9f7-6c22-4a08-ba2a-0f9a3ab677a3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:26.237613 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a75dde96-b2a6-4804-b566-165b576626ff req-1e2af9f7-6c22-4a08-ba2a-0f9a3ab677a3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/networks?id=52eb1d65-dc7c-45c5-9521-97cb18715837 HTTP/1.1" status: 200 len: 814 time: 0.1412528 Nov 08 16:17:26.258902 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a75dde96-b2a6-4804-b566-165b576626ff req-b9903ea0-69fb-446a-9c60-85b7f2d2ace2 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/quotas/9ad6e5c060034b2ca263bfdcb07fe807 HTTP/1.1" status: 200 len: 375 time: 0.0151465 Nov 08 16:17:26.303371 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7faea5c1-6cc8-4fca-ab60-0a2b6583fef7 req-0e8351f2-163a-4006-b50f-11e18389fbc9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0834694 Nov 08 16:17:26.324122 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a75dde96-b2a6-4804-b566-165b576626ff req-2c52d277-4ed4-491a-bb81-bb3c5ecf293b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?tenant_id=9ad6e5c060034b2ca263bfdcb07fe807&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0575218 Nov 08 16:17:26.425513 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a75dde96-b2a6-4804-b566-165b576626ff req-24f177bc-ed0b-4e4a-9c36-7f5f65253b22 service neutron] 10.222.0.37 "GET /v2.0/networks/52eb1d65-dc7c-45c5-9521-97cb18715837?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0895295 Nov 08 16:17:26.518523 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a75dde96-b2a6-4804-b566-165b576626ff req-34980cee-3f1a-463a-aaa8-7a295737c25f service neutron] 10.222.0.37 "GET /v2.0/networks/52eb1d65-dc7c-45c5-9521-97cb18715837?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0867047 Nov 08 16:17:26.688932 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fc4ce036-de18-4d54-897e-feeac045b4b5 req-683dcf1f-5463-4bbe-98ec-26762a7410c5 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 210 time: 0.0289581 Nov 08 16:17:27.427766 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42052eab-10ef-4233-8a2f-b47f18bb90d9 req-2c5d226c-ac0e-4e1c-bfdd-b10ec49fbc22 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:27.429300 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-42052eab-10ef-4233-8a2f-b47f18bb90d9 req-2c5d226c-ac0e-4e1c-bfdd-b10ec49fbc22 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0528901 Nov 08 16:17:27.478777 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-42052eab-10ef-4233-8a2f-b47f18bb90d9 req-522cf3d7-b9e4-45f9-8aa0-f7e392079b05 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434842 Nov 08 16:17:27.783578 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-97d91f6d-cbc9-48d1-9803-ec586bc4b491 req-d4abc0f2-37b2-4af0-9633-99d97f293db5 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 210 time: 0.0265391 Nov 08 16:17:28.599588 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff62f2fe-5926-42a4-9829-0fe34db996b4 req-1e020a0a-3861-440b-ab72-ed2cb0bfb9a0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:28.601101 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ff62f2fe-5926-42a4-9829-0fe34db996b4 req-1e020a0a-3861-440b-ab72-ed2cb0bfb9a0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0494957 Nov 08 16:17:28.603056 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:17:28.649556 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ff62f2fe-5926-42a4-9829-0fe34db996b4 req-683d46bf-6286-45f9-b944-6cef13fa0035 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426855 Nov 08 16:17:28.878946 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ff3eaaac-6229-49f3-b4b4-6fefbed9aee0 req-e492b61b-8fc0-4dbd-a583-eaa3bce4a92a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 210 time: 0.0305727 Nov 08 16:17:29.772317 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34423593-9d3e-4cb2-9a1e-b90cc2a672cd req-53d0310d-017d-456b-8db7-eb0d708dca97 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:29.773879 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-34423593-9d3e-4cb2-9a1e-b90cc2a672cd req-53d0310d-017d-456b-8db7-eb0d708dca97 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0492973 Nov 08 16:17:29.821668 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-34423593-9d3e-4cb2-9a1e-b90cc2a672cd req-ec846936-fc58-4a36-9788-d494530b3f58 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419800 Nov 08 16:17:29.976924 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b374d077-2de0-41c2-9b49-7367eb3f6c6e req-78a5ed1f-f5aa-430e-9998-0aaacc0938c4 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 210 time: 0.0264421 Nov 08 16:17:30.942959 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd3d3f7-245e-4c06-91b7-c218ebabaea2 req-ecf89c59-5b4a-400b-be49-99ad8dde7fcc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:30.944547 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4bd3d3f7-245e-4c06-91b7-c218ebabaea2 req-ecf89c59-5b4a-400b-be49-99ad8dde7fcc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0498827 Nov 08 16:17:30.995949 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4bd3d3f7-245e-4c06-91b7-c218ebabaea2 req-96cf20e2-5ebb-4ecb-9bd9-43329c437624 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454471 Nov 08 16:17:31.071287 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b310d86b-74c0-483f-a66c-264209c7b891 req-a85d7d06-50af-4e8f-9104-c12d291aa821 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 210 time: 0.0266595 Nov 08 16:17:32.131302 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4529e042-37c7-4580-be28-028da40787f3 req-c807e611-4d1c-4544-830a-8fe8ca582dab tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:32.133018 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4529e042-37c7-4580-be28-028da40787f3 req-c807e611-4d1c-4544-830a-8fe8ca582dab tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0618286 Nov 08 16:17:32.185288 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e578a456-b06e-4191-90d7-9b0a4a0c72bc req-ad299da8-192c-401b-9e0d-77ae2ac854c1 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 210 time: 0.0399301 Nov 08 16:17:32.203054 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4529e042-37c7-4580-be28-028da40787f3 req-9e14424b-6794-4bb0-9a82-2d2132cf78d6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0638282 Nov 08 16:17:33.288611 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bf93263e-6a0b-4429-aee8-d3e8193d8c6d req-53b799b9-f6e0-421e-a63d-572a81c75b01 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 210 time: 0.0333846 Nov 08 16:17:33.335653 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-055dba09-3286-4ab2-93ac-5fb202688619 req-b96f5a4c-7796-4e12-bcc0-699fcfb7394b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:33.337147 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-055dba09-3286-4ab2-93ac-5fb202688619 req-b96f5a4c-7796-4e12-bcc0-699fcfb7394b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0517290 Nov 08 16:17:33.384435 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-055dba09-3286-4ab2-93ac-5fb202688619 req-7dfeade9-f7ad-411e-bd65-a58d9f99dc9d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414195 Nov 08 16:17:34.378951 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-65edb6e4-0d96-4688-b6e5-a239608b9eb3 req-75061af4-b473-4922-9efd-98f8433764b8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 210 time: 0.0256581 Nov 08 16:17:34.500379 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01988810-43d7-463a-8ee7-6416c71dcdb2 req-48be8f1f-9ae0-478f-b9c4-588376a2e8c2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:34.501854 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-01988810-43d7-463a-8ee7-6416c71dcdb2 req-48be8f1f-9ae0-478f-b9c4-588376a2e8c2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0474839 Nov 08 16:17:34.551245 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-01988810-43d7-463a-8ee7-6416c71dcdb2 req-c027fa48-499a-4203-bb9f-650e30b19c39 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436587 Nov 08 16:17:35.468143 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-225fc743-05f8-44d8-9fdc-22d48255fb6f req-00663ff0-6f1f-4736-b753-238d6fffb6fa tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 210 time: 0.0252042 Nov 08 16:17:35.667534 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e79df7b-a29d-4a9b-a954-5dd33350522f req-db2401d7-94c1-4b99-8123-45bbe94a7aa9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:35.668914 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0e79df7b-a29d-4a9b-a954-5dd33350522f req-db2401d7-94c1-4b99-8123-45bbe94a7aa9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0489564 Nov 08 16:17:35.715627 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0e79df7b-a29d-4a9b-a954-5dd33350522f req-a00890bc-9f6e-4aa2-8a57-be143a6cb705 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409324 Nov 08 16:17:36.557494 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-330356c1-9b34-463f-836b-b16a6063e7c7 req-03f4caa0-7e84-40f2-b372-f177ad0e6ebd tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 210 time: 0.0252943 Nov 08 16:17:36.833536 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6afc9a71-c666-41c6-b5fa-2f9c6d95162a req-ef88c23a-e849-4e29-9bc3-d7c118942655 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:36.835069 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6afc9a71-c666-41c6-b5fa-2f9c6d95162a req-ef88c23a-e849-4e29-9bc3-d7c118942655 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0501866 Nov 08 16:17:36.881457 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6afc9a71-c666-41c6-b5fa-2f9c6d95162a req-9e37530b-6801-4246-bc6c-742d4bcc1e75 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398188 Nov 08 16:17:37.646797 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-909e7743-24cf-4427-bc40-ed2772c715db req-18857d4f-cba6-4235-9599-2ce5e48c1037 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 210 time: 0.0251541 Nov 08 16:17:37.999207 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24b4c3ce-41ed-490e-a76b-e3631e3be8b4 req-9e6dbf2f-4129-44b5-bc89-d4effccf0295 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:38.001186 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-24b4c3ce-41ed-490e-a76b-e3631e3be8b4 req-9e6dbf2f-4129-44b5-bc89-d4effccf0295 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0475290 Nov 08 16:17:38.049495 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-24b4c3ce-41ed-490e-a76b-e3631e3be8b4 req-1a888366-7596-4def-ab6b-506beb77a22a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417795 Nov 08 16:17:38.120576 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ae9af3d9-642e-4d1f-a68e-e85d1759daaa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:38.752808 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f23111a5-68ba-47e2-9c93-779b93a4fdd8 req-f0049c3e-1c6d-439f-8f92-afecc94f6a95 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 210 time: 0.0368476 Nov 08 16:17:38.764363 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a75dde96-b2a6-4804-b566-165b576626ff req-292ecdf0-cd22-41b8-8cf4-8358d5c9be8f tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:38.766056 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a75dde96-b2a6-4804-b566-165b576626ff req-292ecdf0-cd22-41b8-8cf4-8358d5c9be8f tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.25 "GET /v2.0/networks?id=52eb1d65-dc7c-45c5-9521-97cb18715837 HTTP/1.1" status: 200 len: 814 time: 0.1387687 Nov 08 16:17:38.779947 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-a75dde96-b2a6-4804-b566-165b576626ff req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Request body: {'port': {'device_id': '4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912', 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837', 'admin_state_up': True, 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:17:38.893038 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a75dde96-b2a6-4804-b566-165b576626ff req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Made reservation on behalf of 9ad6e5c060034b2ca263bfdcb07fe807 for: {'port': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:17:38.896667 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-a75dde96-b2a6-4804-b566-165b576626ff req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:39.030402 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [req-a75dde96-b2a6-4804-b566-165b576626ff req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Allocated IP 172.20.0.5 (52eb1d65-dc7c-45c5-9521-97cb18715837/12999abd-2828-4905-aed0-938c2f27aed8/304e385a-c4e3-48f0-8723-230b5da69dc3) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:17:39.270737 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-a75dde96-b2a6-4804-b566-165b576626ff req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:39.353049 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a79a807b-2f0a-474d-9476-464cc9d6afd5 req-d580d7dc-c2eb-4ed9-a93b-57290c2b5186 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:39.354770 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a79a807b-2f0a-474d-9476-464cc9d6afd5 req-d580d7dc-c2eb-4ed9-a93b-57290c2b5186 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.2130136 Nov 08 16:17:39.357932 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-a75dde96-b2a6-4804-b566-165b576626ff req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:39.429350 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a75dde96-b2a6-4804-b566-165b576626ff req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Network 52eb1d65-dc7c-45c5-9521-97cb18715837 is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:17:39.438276 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [req-a75dde96-b2a6-4804-b566-165b576626ff req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:17:39.440812 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-a75dde96-b2a6-4804-b566-165b576626ff req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:17:39.478573 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Pushing event updated for resources: {'Port': ['ID=304e385a-c4e3-48f0-8723-230b5da69dc3,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:39.486627 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a79a807b-2f0a-474d-9476-464cc9d6afd5 req-4f35e358-884a-4408-b4a6-0eb5bdfc7d12 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1189234 Nov 08 16:17:39.507297 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:39.507639 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:39.507920 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:39.508248 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:39.508572 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:39.508944 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:39.509212 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:39.509531 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:39.509871 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:39.510183 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:39.510497 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:39.510806 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:39.549033 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a75dde96-b2a6-4804-b566-165b576626ff req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:39.549859 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-a75dde96-b2a6-4804-b566-165b576626ff req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:39.567684 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a75dde96-b2a6-4804-b566-165b576626ff req-6a7baff8-42c8-4150-91e4-e21d1e48b153 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7913511 Nov 08 16:17:39.702746 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-a41b4a0d-f750-4bb4-8461-c4c3ebf1b8f7 None None] Provisioning complete for port 304e385a-c4e3-48f0-8723-230b5da69dc3 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:17:39.703374 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-a41b4a0d-f750-4bb4-8461-c4c3ebf1b8f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:39.736645 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-a41b4a0d-f750-4bb4-8461-c4c3ebf1b8f7 None None] Port 304e385a-c4e3-48f0-8723-230b5da69dc3 cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:17:39.871849 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0607bc3-7227-4cf2-8560-5db1a3c6a05e req-4c0c0e1c-2f59-424c-b7b8-ed1a87c7b6fe tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:39.873515 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d0607bc3-7227-4cf2-8560-5db1a3c6a05e req-4c0c0e1c-2f59-424c-b7b8-ed1a87c7b6fe tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 931 time: 0.0510645 Nov 08 16:17:39.926794 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d0607bc3-7227-4cf2-8560-5db1a3c6a05e req-14e389ff-5129-4f23-b598-8da8938a7dff tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465205 Nov 08 16:17:40.354807 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 40136) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:17:40.460734 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b79e01d5-86b8-4115-bd5e-480032a31f42 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:40.547447 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b79e01d5-86b8-4115-bd5e-480032a31f42 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:40.575287 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-b79e01d5-86b8-4115-bd5e-480032a31f42 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:40.594975 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-e808b1a3-2709-43ca-8650-91a2bf842b5c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:40.644392 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-b79e01d5-86b8-4115-bd5e-480032a31f42 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=aba4b91db4a64c73b3079ed1981fb116&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2884097 Nov 08 16:17:40.647772 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 40142) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:17:40.650877 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b79e01d5-86b8-4115-bd5e-480032a31f42 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d917476f-8a4f-498c-a0ad-4a12b5d84f35,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:40.670034 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df8c1f66-2ebb-4164-a1d8-5ffbb1865644 req-4d62afa5-cd15-42f3-96f1-49ad99fc4551 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:40.672440 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-df8c1f66-2ebb-4164-a1d8-5ffbb1865644 req-4d62afa5-cd15-42f3-96f1-49ad99fc4551 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0778203 Nov 08 16:17:40.711966 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f0f3fcff-ff83-49a6-a929-12e4388aa58d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:40.733167 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-df8c1f66-2ebb-4164-a1d8-5ffbb1865644 req-05ccd233-1cbe-48c8-8d66-271f71907b14 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0546303 Nov 08 16:17:40.740758 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f0f3fcff-ff83-49a6-a929-12e4388aa58d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:40.789842 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f0f3fcff-ff83-49a6-a929-12e4388aa58d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:40.792389 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f0f3fcff-ff83-49a6-a929-12e4388aa58d admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:40.793521 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-f0f3fcff-ff83-49a6-a929-12e4388aa58d admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/d917476f-8a4f-498c-a0ad-4a12b5d84f35 HTTP/1.1" status: 204 len: 168 time: 0.1447639 Nov 08 16:17:40.801906 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0f3fcff-ff83-49a6-a929-12e4388aa58d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d917476f-8a4f-498c-a0ad-4a12b5d84f35,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:40.809210 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0f3fcff-ff83-49a6-a929-12e4388aa58d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:40.809551 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0f3fcff-ff83-49a6-a929-12e4388aa58d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:40.809919 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0f3fcff-ff83-49a6-a929-12e4388aa58d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:40.810247 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0f3fcff-ff83-49a6-a929-12e4388aa58d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:40.810574 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0f3fcff-ff83-49a6-a929-12e4388aa58d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:40.810915 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0f3fcff-ff83-49a6-a929-12e4388aa58d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:40.811220 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0f3fcff-ff83-49a6-a929-12e4388aa58d admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:40.811543 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0f3fcff-ff83-49a6-a929-12e4388aa58d admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:40.811900 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0f3fcff-ff83-49a6-a929-12e4388aa58d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:40.812206 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0f3fcff-ff83-49a6-a929-12e4388aa58d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:40.812700 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0f3fcff-ff83-49a6-a929-12e4388aa58d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:40.813023 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0f3fcff-ff83-49a6-a929-12e4388aa58d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:17:41.486005 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3c24c51-048b-4489-8b68-5a83172a321a req-992b8eba-bfd9-4ee5-96a2-b428f1ea0ae8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:41.487616 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c3c24c51-048b-4489-8b68-5a83172a321a req-992b8eba-bfd9-4ee5-96a2-b428f1ea0ae8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 931 time: 0.3293214 Nov 08 16:17:41.540343 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:41.541264 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c3c24c51-048b-4489-8b68-5a83172a321a req-2ceb6d7a-5ca4-4c1f-a0ba-a42a536fbc05 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471895 Nov 08 16:17:41.866274 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-653df313-39cc-471e-9e79-eacd2a57fca5 req-7772e0cd-3dd7-4f5f-8054-00ce2591364f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:41.868178 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-653df313-39cc-471e-9e79-eacd2a57fca5 req-7772e0cd-3dd7-4f5f-8054-00ce2591364f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0557668 Nov 08 16:17:41.942428 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-653df313-39cc-471e-9e79-eacd2a57fca5 req-9a29d3be-e35f-4b0d-ae6a-20fe92739951 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0678210 Nov 08 16:17:42.660773 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1715d59a-bc8d-4880-a776-61a6156deba7 req-c4936d51-d0c9-49f2-bdac-ea225a292fa1 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:42.662324 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1715d59a-bc8d-4880-a776-61a6156deba7 req-c4936d51-d0c9-49f2-bdac-ea225a292fa1 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 931 time: 0.0495925 Nov 08 16:17:42.712959 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1715d59a-bc8d-4880-a776-61a6156deba7 req-77920980-d5b6-4056-8be2-6ebef07f5d2e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446231 Nov 08 16:17:43.071070 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3015241d-e0f4-4ee0-9bac-b149e9c739ca req-ee7eb8fb-a8d7-4d96-8391-980839626cc9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:43.072582 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3015241d-e0f4-4ee0-9bac-b149e9c739ca req-ee7eb8fb-a8d7-4d96-8391-980839626cc9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0521631 Nov 08 16:17:43.134702 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3015241d-e0f4-4ee0-9bac-b149e9c739ca req-b760bdbc-1d4d-457b-838f-909452bc1b8d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0554700 Nov 08 16:17:43.266449 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:43.824110 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20f1bc2b-8fd8-48d9-bfb2-6eb00e52e8fc req-a988af6a-1f6b-49d1-8f08-ffaf8a9cc4ac tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:43.825536 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-20f1bc2b-8fd8-48d9-bfb2-6eb00e52e8fc req-a988af6a-1f6b-49d1-8f08-ffaf8a9cc4ac tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 931 time: 0.0461347 Nov 08 16:17:43.875046 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-20f1bc2b-8fd8-48d9-bfb2-6eb00e52e8fc req-b4718281-230d-4ee8-bd71-4761d54563c4 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424523 Nov 08 16:17:43.956499 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:44.261096 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6dea372-ddcb-4f7e-8bf5-158740e5f5bd req-7138d888-a63a-4d1d-a1f0-d14e2acdc211 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:44.262941 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d6dea372-ddcb-4f7e-8bf5-158740e5f5bd req-7138d888-a63a-4d1d-a1f0-d14e2acdc211 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0533991 Nov 08 16:17:44.310783 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d6dea372-ddcb-4f7e-8bf5-158740e5f5bd req-b0e0594c-3c1e-4326-8567-ff6578502a21 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415611 Nov 08 16:17:44.989843 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68efad35-85e7-465e-9b72-144b083da6a3 req-783393e5-2292-4a09-93b5-c298e2afd44c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:44.991289 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-68efad35-85e7-465e-9b72-144b083da6a3 req-783393e5-2292-4a09-93b5-c298e2afd44c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 931 time: 0.0465815 Nov 08 16:17:45.036869 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-68efad35-85e7-465e-9b72-144b083da6a3 req-8ac6ac27-4586-44ec-ab3c-45b4d42f6e27 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394180 Nov 08 16:17:45.428660 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9bb425d-0316-480e-a05e-e957b5417691 req-6e128d01-8d4a-4abf-a261-2af484616ed3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:45.430107 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a9bb425d-0316-480e-a05e-e957b5417691 req-6e128d01-8d4a-4abf-a261-2af484616ed3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0468001 Nov 08 16:17:45.479265 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a9bb425d-0316-480e-a05e-e957b5417691 req-5934f897-03a3-4af8-af24-370450228fe2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433304 Nov 08 16:17:46.147351 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aafbb310-ee87-4c2b-98a6-e1fcfbf75b1b req-b3ec86e1-25eb-48de-8693-2dbc525fc476 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:46.148808 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-aafbb310-ee87-4c2b-98a6-e1fcfbf75b1b req-b3ec86e1-25eb-48de-8693-2dbc525fc476 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 931 time: 0.0477519 Nov 08 16:17:46.194082 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-aafbb310-ee87-4c2b-98a6-e1fcfbf75b1b req-c8e7e601-4607-407a-8583-9b289823ddf4 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394778 Nov 08 16:17:46.595879 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec26e310-7403-4426-afbc-ca3b0b9ec7a1 req-5db973d6-02b0-48ee-acf9-d14ea308e76d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:46.597374 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ec26e310-7403-4426-afbc-ca3b0b9ec7a1 req-5db973d6-02b0-48ee-acf9-d14ea308e76d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0477715 Nov 08 16:17:46.641991 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ec26e310-7403-4426-afbc-ca3b0b9ec7a1 req-067b1de2-9a85-46de-a175-9e6ac8ef5894 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388348 Nov 08 16:17:47.332297 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29a357b4-8633-4735-a24c-20b83a31a8aa req-2b56d0a0-436d-414a-8899-6d3f87ed6633 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:47.333932 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-29a357b4-8633-4735-a24c-20b83a31a8aa req-2b56d0a0-436d-414a-8899-6d3f87ed6633 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 931 time: 0.0724792 Nov 08 16:17:47.385931 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-29a357b4-8633-4735-a24c-20b83a31a8aa req-97ced1c9-55ef-4e4a-902a-7ab41dfd00a1 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434427 Nov 08 16:17:47.761443 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12fa5825-0f8c-4042-b27d-54c8db6dffc7 req-eea7ceb1-2a4a-4048-a533-8d2ec75336d3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:47.762921 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-12fa5825-0f8c-4042-b27d-54c8db6dffc7 req-eea7ceb1-2a4a-4048-a533-8d2ec75336d3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0490792 Nov 08 16:17:47.807546 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-12fa5825-0f8c-4042-b27d-54c8db6dffc7 req-f60a9e91-097f-4ea2-bda2-881fa3cc3bde tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0383661 Nov 08 16:17:47.934396 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:48.506493 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53571915-daec-49c9-ab0d-397ff6ca45da req-648ecca8-1105-4a07-a73f-eb52a9d3d4bf tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:48.508120 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-53571915-daec-49c9-ab0d-397ff6ca45da req-648ecca8-1105-4a07-a73f-eb52a9d3d4bf tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 931 time: 0.0523942 Nov 08 16:17:48.557032 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-53571915-daec-49c9-ab0d-397ff6ca45da req-0e19903a-c671-4188-bbb8-1cfd81c7e101 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410230 Nov 08 16:17:48.927389 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3afc37f9-d0de-40bf-b09d-8d7914af2983 req-2331d19e-5d98-45fb-8d0e-9dd42cd369a6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:48.928852 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3afc37f9-d0de-40bf-b09d-8d7914af2983 req-2331d19e-5d98-45fb-8d0e-9dd42cd369a6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0477312 Nov 08 16:17:48.974145 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3afc37f9-d0de-40bf-b09d-8d7914af2983 req-89ef81ce-1b7c-4cd5-89cb-ec7769d3eee5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395734 Nov 08 16:17:49.668865 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbec133f-8ef9-4818-b936-24230321d9ea req-2eb598f1-d88c-450c-87e9-af9293a14963 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:49.670237 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dbec133f-8ef9-4818-b936-24230321d9ea req-2eb598f1-d88c-450c-87e9-af9293a14963 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 931 time: 0.0468178 Nov 08 16:17:49.718479 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dbec133f-8ef9-4818-b936-24230321d9ea req-16449d73-6539-4498-b006-a0495f61cace tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418642 Nov 08 16:17:50.099482 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44d01086-9a23-4b17-b8db-e6e4eb498f1b req-c0b29e7c-b2d4-482d-be41-0a77c4967e00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:50.101154 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-44d01086-9a23-4b17-b8db-e6e4eb498f1b req-c0b29e7c-b2d4-482d-be41-0a77c4967e00 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0513175 Nov 08 16:17:50.150498 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-44d01086-9a23-4b17-b8db-e6e4eb498f1b req-21adbb75-3953-4119-8bf2-cee961dd2761 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412977 Nov 08 16:17:50.830909 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb583902-d6c3-49e6-99c9-931255eb5330 req-4ab2d842-9f60-46b5-947e-55cf51c014ba tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:50.832360 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fb583902-d6c3-49e6-99c9-931255eb5330 req-4ab2d842-9f60-46b5-947e-55cf51c014ba tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 931 time: 0.0472438 Nov 08 16:17:50.881881 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fb583902-d6c3-49e6-99c9-931255eb5330 req-68d0eead-d25c-4c44-a19b-af7ae3ffe821 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436120 Nov 08 16:17:51.276757 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c9bd64-7e21-44cd-a398-6ca32ef412f5 req-1fdf9690-9a27-4763-9191-80cef331022f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:51.278391 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-98c9bd64-7e21-44cd-a398-6ca32ef412f5 req-1fdf9690-9a27-4763-9191-80cef331022f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0532167 Nov 08 16:17:51.326301 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-98c9bd64-7e21-44cd-a398-6ca32ef412f5 req-7811e4c8-4bbd-439c-81e2-1145299c8df5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418162 Nov 08 16:17:51.992199 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3aab1e9-fa80-42bf-992c-840f217f4374 req-69a4e188-ff93-4a0f-a7f4-96d5639a66de tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:51.993644 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a3aab1e9-fa80-42bf-992c-840f217f4374 req-69a4e188-ff93-4a0f-a7f4-96d5639a66de tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 931 time: 0.0471463 Nov 08 16:17:52.039638 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a3aab1e9-fa80-42bf-992c-840f217f4374 req-b5371a5f-12f0-4ea5-8917-bcc637c93005 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398724 Nov 08 16:17:52.443858 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5f97a94-42f1-4720-9903-c2c263c4088f req-bb6597a5-e3d8-439b-b9dd-a848ab8ea70c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:52.445295 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d5f97a94-42f1-4720-9903-c2c263c4088f req-bb6597a5-e3d8-439b-b9dd-a848ab8ea70c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0462363 Nov 08 16:17:52.497643 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d5f97a94-42f1-4720-9903-c2c263c4088f req-f8ba986c-b711-4412-8aea-26f0d9cfb616 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463850 Nov 08 16:17:53.158593 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c5bcc15-1d7d-4d24-8319-c9350f740d56 req-9db24363-5be5-4b66-937c-de6e4881abef tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:53.160232 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9c5bcc15-1d7d-4d24-8319-c9350f740d56 req-9db24363-5be5-4b66-937c-de6e4881abef tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 931 time: 0.0511639 Nov 08 16:17:53.209014 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9c5bcc15-1d7d-4d24-8319-c9350f740d56 req-01bdc479-6c4a-414a-a90d-c4252455c7b7 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426638 Nov 08 16:17:53.616829 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac9671c8-1ebd-49a3-a611-09f34af6efaa req-0e48bf35-b57c-4df2-9d83-409748a021e2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:53.618337 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ac9671c8-1ebd-49a3-a611-09f34af6efaa req-0e48bf35-b57c-4df2-9d83-409748a021e2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0479434 Nov 08 16:17:53.663884 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ac9671c8-1ebd-49a3-a611-09f34af6efaa req-5374c78c-673a-49b3-ad4f-42fa585e5fe5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394435 Nov 08 16:17:54.327487 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9a8f381-d9bb-4e4f-8035-72fac12afb5c req-addb11d0-d51e-4bf5-8db4-bf28a981385b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:54.329000 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d9a8f381-d9bb-4e4f-8035-72fac12afb5c req-addb11d0-d51e-4bf5-8db4-bf28a981385b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 931 time: 0.0534823 Nov 08 16:17:54.379394 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d9a8f381-d9bb-4e4f-8035-72fac12afb5c req-9e919088-0d46-460d-93ac-64ddc0ec816e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443876 Nov 08 16:17:54.783198 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c4944fd-4a52-43e8-b966-ffed1857dc72 req-55782142-3941-44c9-9810-f19cd88730f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:54.784852 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8c4944fd-4a52-43e8-b966-ffed1857dc72 req-55782142-3941-44c9-9810-f19cd88730f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0502207 Nov 08 16:17:54.832856 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8c4944fd-4a52-43e8-b966-ffed1857dc72 req-46a182e4-a4a6-4c1f-b211-e8339728f406 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417857 Nov 08 16:17:55.502930 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75bd6b81-b03f-46ed-8838-4889064a8640 req-60fa66c3-11b6-4c90-b146-eec4fa9f2493 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:55.504398 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-75bd6b81-b03f-46ed-8838-4889064a8640 req-60fa66c3-11b6-4c90-b146-eec4fa9f2493 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 931 time: 0.0549517 Nov 08 16:17:55.549980 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-75bd6b81-b03f-46ed-8838-4889064a8640 req-4f2137c3-8e40-4768-a5cb-ffe266e90949 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397565 Nov 08 16:17:55.950299 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7515d04a-33b2-47b1-87dd-314801a82000 req-b94ad1d9-7126-4f5f-9930-dfae4d6b0cc2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:55.951685 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7515d04a-33b2-47b1-87dd-314801a82000 req-b94ad1d9-7126-4f5f-9930-dfae4d6b0cc2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0479729 Nov 08 16:17:55.997932 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7515d04a-33b2-47b1-87dd-314801a82000 req-04eb1cff-c5f9-4ca2-b7cf-0b9a813c34d2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404665 Nov 08 16:17:56.666723 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-559e8071-9b8e-4834-b5ee-5c68061ce285 req-99dbecf5-5364-479e-b01a-439d52131943 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:56.669034 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-559e8071-9b8e-4834-b5ee-5c68061ce285 req-99dbecf5-5364-479e-b01a-439d52131943 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 931 time: 0.0487266 Nov 08 16:17:56.719796 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-559e8071-9b8e-4834-b5ee-5c68061ce285 req-3d44a644-6bd3-497b-958c-f77ade09a157 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446336 Nov 08 16:17:57.115709 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e44fe44d-0839-4119-863b-8debaab0f304 req-cb6e9468-a775-4921-a935-ca2ca3aabdf5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:57.117260 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e44fe44d-0839-4119-863b-8debaab0f304 req-cb6e9468-a775-4921-a935-ca2ca3aabdf5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0502951 Nov 08 16:17:57.165167 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e44fe44d-0839-4119-863b-8debaab0f304 req-048896f4-ad0e-4f9a-9537-9a1bf1cbb5a6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408580 Nov 08 16:17:57.533548 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-a75dde96-b2a6-4804-b566-165b576626ff req-f4bcd879-1f6c-4b8d-923b-09786988f23f service neutron] Request body: {'port': {'device_id': '4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81618'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:17:57.586594 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-a75dde96-b2a6-4804-b566-165b576626ff req-f4bcd879-1f6c-4b8d-923b-09786988f23f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:57.874778 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0885011-706b-4ffc-9d35-1541b2c9d95e req-9c7f8326-56cd-427f-8c95-64cf3a050a85 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:57.876327 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f0885011-706b-4ffc-9d35-1541b2c9d95e req-9c7f8326-56cd-427f-8c95-64cf3a050a85 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 931 time: 0.0879824 Nov 08 16:17:57.894869 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [req-a75dde96-b2a6-4804-b566-165b576626ff req-f4bcd879-1f6c-4b8d-923b-09786988f23f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 304e385a-c4e3-48f0-8723-230b5da69dc3 {{(pid=101244) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:17:57.909039 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-a75dde96-b2a6-4804-b566-165b576626ff req-f4bcd879-1f6c-4b8d-923b-09786988f23f service neutron] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:57.933485 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.provisioning_blocks [req-a75dde96-b2a6-4804-b566-165b576626ff req-f4bcd879-1f6c-4b8d-923b-09786988f23f service neutron] Transition to ACTIVE for port object 304e385a-c4e3-48f0-8723-230b5da69dc3 will not be triggered until provisioned by entity L2. {{(pid=101244) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 16:17:57.943403 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-a75dde96-b2a6-4804-b566-165b576626ff req-f4bcd879-1f6c-4b8d-923b-09786988f23f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:57.952181 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f0885011-706b-4ffc-9d35-1541b2c9d95e req-e2aa1629-0652-46a3-99c4-c225d1e8ad3d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0662220 Nov 08 16:17:58.002902 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4bcd879-1f6c-4b8d-923b-09786988f23f service neutron] Pushing event updated for resources: {'Port': ['ID=304e385a-c4e3-48f0-8723-230b5da69dc3,revision_number=2']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:58.078081 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-a75dde96-b2a6-4804-b566-165b576626ff req-f4bcd879-1f6c-4b8d-923b-09786988f23f service neutron] Attempting to bind port 304e385a-c4e3-48f0-8723-230b5da69dc3 on host hv-cinder-81618 for vnic_type normal with profile {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:17:58.078419 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-a75dde96-b2a6-4804-b566-165b576626ff req-f4bcd879-1f6c-4b8d-923b-09786988f23f service neutron] Attempting to bind port 304e385a-c4e3-48f0-8723-230b5da69dc3 by drivers openvswitch,hyperv on host hv-cinder-81618 at level 0 using segments [{'id': '1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 179, 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837'}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:17:58.078751 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a75dde96-b2a6-4804-b566-165b576626ff req-f4bcd879-1f6c-4b8d-923b-09786988f23f service neutron] Attempting to bind port 304e385a-c4e3-48f0-8723-230b5da69dc3 on network 52eb1d65-dc7c-45c5-9521-97cb18715837 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:17:58.088571 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a75dde96-b2a6-4804-b566-165b576626ff req-f4bcd879-1f6c-4b8d-923b-09786988f23f service neutron] Port 304e385a-c4e3-48f0-8723-230b5da69dc3 on network 52eb1d65-dc7c-45c5-9521-97cb18715837 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81618 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 16:17:58.088939 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a75dde96-b2a6-4804-b566-165b576626ff req-f4bcd879-1f6c-4b8d-923b-09786988f23f service neutron] Attempting to bind port 304e385a-c4e3-48f0-8723-230b5da69dc3 on network 52eb1d65-dc7c-45c5-9521-97cb18715837 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:17:58.094732 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a75dde96-b2a6-4804-b566-165b576626ff req-f4bcd879-1f6c-4b8d-923b-09786988f23f service neutron] Checking agent: {'id': '54bf9779-c14d-412a-90fc-96b4a6589d5a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81618', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'started_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 17, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:17:58.095064 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a75dde96-b2a6-4804-b566-165b576626ff req-f4bcd879-1f6c-4b8d-923b-09786988f23f service neutron] Checking segment: {'id': '1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 179, 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:17:58.095441 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a75dde96-b2a6-4804-b566-165b576626ff req-f4bcd879-1f6c-4b8d-923b-09786988f23f service neutron] Bound using segment: {'id': '1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 179, 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837'} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:17:58.095882 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-a75dde96-b2a6-4804-b566-165b576626ff req-f4bcd879-1f6c-4b8d-923b-09786988f23f service neutron] Bound port: 304e385a-c4e3-48f0-8723-230b5da69dc3, host: hv-cinder-81618, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 179, 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837'}}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:17:58.096251 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-a75dde96-b2a6-4804-b566-165b576626ff req-f4bcd879-1f6c-4b8d-923b-09786988f23f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:58.176223 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-a75dde96-b2a6-4804-b566-165b576626ff req-f4bcd879-1f6c-4b8d-923b-09786988f23f service neutron] For port 304e385a-c4e3-48f0-8723-230b5da69dc3, host hv-cinder-81618, cleared binding levels {{(pid=101244) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:17:58.178675 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-a75dde96-b2a6-4804-b566-165b576626ff req-f4bcd879-1f6c-4b8d-923b-09786988f23f service neutron] For port 304e385a-c4e3-48f0-8723-230b5da69dc3, host hv-cinder-81618, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=304e385a-c4e3-48f0-8723-230b5da69dc3,segment=NetworkSegment(1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3),segment_id=1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3)] {{(pid=101244) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:17:58.184192 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-a75dde96-b2a6-4804-b566-165b576626ff req-f4bcd879-1f6c-4b8d-923b-09786988f23f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:58.224568 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a75dde96-b2a6-4804-b566-165b576626ff req-f4bcd879-1f6c-4b8d-923b-09786988f23f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:58.225280 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-a75dde96-b2a6-4804-b566-165b576626ff req-f4bcd879-1f6c-4b8d-923b-09786988f23f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:17:58.226954 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a75dde96-b2a6-4804-b566-165b576626ff req-f4bcd879-1f6c-4b8d-923b-09786988f23f service neutron] 10.222.0.25 "PUT /v2.0/ports/304e385a-c4e3-48f0-8723-230b5da69dc3 HTTP/1.1" status: 200 len: 1093 time: 0.6984799 Nov 08 16:17:58.227567 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912', 'tag': '304e385a-c4e3-48f0-8723-230b5da69dc3'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:17:58.230082 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dcadce82-5278-4444-9c79-2a076722a644" -d '{"events": [{"name": "network-changed", "server_uuid": "4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912", "tag": "304e385a-c4e3-48f0-8723-230b5da69dc3"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:17:58.293908 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4bcd879-1f6c-4b8d-923b-09786988f23f service neutron] Pushing event updated for resources: {'Port': ['ID=304e385a-c4e3-48f0-8723-230b5da69dc3,revision_number=3']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:17:58.363998 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbd6062d-6a02-4524-a2af-8ce8b549f602 req-fa70a04a-0ee7-41b8-9d86-3c62c83293fa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:58.365851 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fbd6062d-6a02-4524-a2af-8ce8b549f602 req-fa70a04a-0ee7-41b8-9d86-3c62c83293fa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.1147718 Nov 08 16:17:58.375132 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a75dde96-b2a6-4804-b566-165b576626ff req-e1069544-3889-4938-a808-5c0742f00af1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:58.376466 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a75dde96-b2a6-4804-b566-165b576626ff req-e1069544-3889-4938-a808-5c0742f00af1 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=9ad6e5c060034b2ca263bfdcb07fe807&device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 1096 time: 0.0783086 Nov 08 16:17:58.433360 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:17:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fd5e3996-e6dd-4dfa-b76f-cd7abf525d21 x-openstack-request-id: req-fd5e3996-e6dd-4dfa-b76f-cd7abf525d21 {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:17:58.433664 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912", "tag": "304e385a-c4e3-48f0-8723-230b5da69dc3", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:17:58.433920 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-fd5e3996-e6dd-4dfa-b76f-cd7abf525d21 {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:17:58.434318 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912', 'tag': '304e385a-c4e3-48f0-8723-230b5da69dc3', 'status': 'completed', 'code': 200} Nov 08 16:17:58.437756 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a75dde96-b2a6-4804-b566-165b576626ff req-e24058c8-39a5-4979-8c27-96c350ea8ca0 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=304e385a-c4e3-48f0-8723-230b5da69dc3 HTTP/1.1" status: 200 len: 217 time: 0.0517955 Nov 08 16:17:58.495704 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fbd6062d-6a02-4524-a2af-8ce8b549f602 req-955125e0-320a-4dde-ac7c-b7fb6761ae84 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1182215 Nov 08 16:17:58.506918 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a75dde96-b2a6-4804-b566-165b576626ff req-503d78e1-d588-4c9a-9279-877fb4d4e228 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:58.508366 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a75dde96-b2a6-4804-b566-165b576626ff req-503d78e1-d588-4c9a-9279-877fb4d4e228 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=12999abd-2828-4905-aed0-938c2f27aed8 HTTP/1.1" status: 200 len: 853 time: 0.0598438 Nov 08 16:17:58.553447 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a75dde96-b2a6-4804-b566-165b576626ff req-9715940e-d2ad-4ee3-9d25-c58c19d45e15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:58.554871 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a75dde96-b2a6-4804-b566-165b576626ff req-9715940e-d2ad-4ee3-9d25-c58c19d45e15 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=52eb1d65-dc7c-45c5-9521-97cb18715837&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0392122 Nov 08 16:17:58.645281 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a75dde96-b2a6-4804-b566-165b576626ff req-32f06fd1-e9c5-4eec-a67f-fe086e6f9429 service neutron] 10.222.0.25 "GET /v2.0/networks/52eb1d65-dc7c-45c5-9521-97cb18715837?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0826614 Nov 08 16:17:58.731908 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a75dde96-b2a6-4804-b566-165b576626ff req-4650c181-d5b1-49b4-b1fc-0c1a5aa46626 service neutron] 10.222.0.25 "GET /v2.0/networks/52eb1d65-dc7c-45c5-9521-97cb18715837?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0792761 Nov 08 16:17:58.819387 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcadce82-5278-4444-9c79-2a076722a644 req-668ccac8-d427-406c-b7ba-da024959bbfd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:58.820833 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dcadce82-5278-4444-9c79-2a076722a644 req-668ccac8-d427-406c-b7ba-da024959bbfd service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=9ad6e5c060034b2ca263bfdcb07fe807&device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 1096 time: 0.0435336 Nov 08 16:17:58.908741 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcadce82-5278-4444-9c79-2a076722a644 req-d9136ee1-cf93-4303-a9aa-ab4f0a7dab4a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:58.910258 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dcadce82-5278-4444-9c79-2a076722a644 req-d9136ee1-cf93-4303-a9aa-ab4f0a7dab4a service neutron] 10.222.0.25 "GET /v2.0/networks?id=52eb1d65-dc7c-45c5-9521-97cb18715837 HTTP/1.1" status: 200 len: 915 time: 0.0822437 Nov 08 16:17:58.951088 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dcadce82-5278-4444-9c79-2a076722a644 req-523e53e2-82b8-49c6-8f5e-485750356726 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=304e385a-c4e3-48f0-8723-230b5da69dc3 HTTP/1.1" status: 200 len: 217 time: 0.0331697 Nov 08 16:17:59.006732 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcadce82-5278-4444-9c79-2a076722a644 req-f6c46e20-0eab-4f57-a689-2ab4978c8797 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:59.008403 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dcadce82-5278-4444-9c79-2a076722a644 req-f6c46e20-0eab-4f57-a689-2ab4978c8797 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=12999abd-2828-4905-aed0-938c2f27aed8 HTTP/1.1" status: 200 len: 853 time: 0.0494471 Nov 08 16:17:59.081272 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcadce82-5278-4444-9c79-2a076722a644 req-b61e8ab5-e4b8-4391-95fe-73c6526d17e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:59.082692 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dcadce82-5278-4444-9c79-2a076722a644 req-b61e8ab5-e4b8-4391-95fe-73c6526d17e2 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=52eb1d65-dc7c-45c5-9521-97cb18715837&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0669286 Nov 08 16:17:59.090991 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-960c39a2-e29f-483a-9232-609a19d9a81c req-79ba1a56-0ef2-4fcf-9f4a-021d29540033 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:59.092864 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-960c39a2-e29f-483a-9232-609a19d9a81c req-79ba1a56-0ef2-4fcf-9f4a-021d29540033 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 943 time: 0.0689096 Nov 08 16:17:59.192961 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-960c39a2-e29f-483a-9232-609a19d9a81c req-ca40ba11-ec04-45c2-9763-a00cd6bbc431 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0924439 Nov 08 16:17:59.208328 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dcadce82-5278-4444-9c79-2a076722a644 req-cd2bbc53-6f31-4e50-b401-c385ff3d5c76 service neutron] 10.222.0.25 "GET /v2.0/networks/52eb1d65-dc7c-45c5-9521-97cb18715837?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1145926 Nov 08 16:17:59.297119 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dcadce82-5278-4444-9c79-2a076722a644 req-80b4e5bc-03b8-4dcf-8b9d-bf5de98a5076 service neutron] 10.222.0.25 "GET /v2.0/networks/52eb1d65-dc7c-45c5-9521-97cb18715837?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0809140 Nov 08 16:17:59.617688 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b8d68e1-9585-4245-b8fd-fb8a7c4ec799 req-4f0f9e69-16c4-4288-9b65-dda8d461476f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:17:59.619114 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5b8d68e1-9585-4245-b8fd-fb8a7c4ec799 req-4f0f9e69-16c4-4288-9b65-dda8d461476f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0515237 Nov 08 16:17:59.664248 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5b8d68e1-9585-4245-b8fd-fb8a7c4ec799 req-68bb5dd3-a432-45cf-9929-ab77c2f5221d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387385 Nov 08 16:18:00.304801 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb5bee1d-bcea-4967-8873-174328d734af req-3f9fd54a-58f7-461e-9a21-655649f27a48 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:00.306283 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cb5bee1d-bcea-4967-8873-174328d734af req-3f9fd54a-58f7-461e-9a21-655649f27a48 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 943 time: 0.0472713 Nov 08 16:18:00.351440 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cb5bee1d-bcea-4967-8873-174328d734af req-2154ee94-f7ef-4b23-ae90-4bc0a0865fb7 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392504 Nov 08 16:18:00.784941 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e4ed3fd-c1de-42d9-a3a9-0b98112a6b61 req-760636b2-b40f-4a30-b610-105870751473 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:00.786416 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8e4ed3fd-c1de-42d9-a3a9-0b98112a6b61 req-760636b2-b40f-4a30-b610-105870751473 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0502787 Nov 08 16:18:00.831926 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8e4ed3fd-c1de-42d9-a3a9-0b98112a6b61 req-55e4243f-a3ac-4954-883d-0fec34eff5c5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395796 Nov 08 16:18:01.468887 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1189a1ba-b237-4600-95fa-96fa7a6c366e req-aa6fc8b5-799b-423f-8301-65d9fba79f32 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:01.470417 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1189a1ba-b237-4600-95fa-96fa7a6c366e req-aa6fc8b5-799b-423f-8301-65d9fba79f32 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 943 time: 0.0534606 Nov 08 16:18:01.516632 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1189a1ba-b237-4600-95fa-96fa7a6c366e req-eedd1d7b-a43c-48a9-bdd7-7dcb071b8446 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403709 Nov 08 16:18:01.948020 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19c0638d-4c56-4657-af5b-f3dca61618b1 req-35ec9dfa-7042-43b5-9a63-c4364f1aab54 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:01.949435 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-19c0638d-4c56-4657-af5b-f3dca61618b1 req-35ec9dfa-7042-43b5-9a63-c4364f1aab54 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0461719 Nov 08 16:18:01.996820 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-19c0638d-4c56-4657-af5b-f3dca61618b1 req-83211c31-3383-44c7-b9d8-470f26fb0210 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409989 Nov 08 16:18:02.626122 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16b27e2d-9b46-498d-8f5c-92f37cd372f3 req-0ac23b0f-2424-432a-881b-fbc8de440ed0 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:02.627567 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-16b27e2d-9b46-498d-8f5c-92f37cd372f3 req-0ac23b0f-2424-432a-881b-fbc8de440ed0 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 943 time: 0.0470002 Nov 08 16:18:02.673265 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-16b27e2d-9b46-498d-8f5c-92f37cd372f3 req-aa2d2026-8318-4b6b-a2f3-9c09f3ef5154 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399129 Nov 08 16:18:03.113155 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcc95ff4-c3db-47a3-b292-9bc1af8c0c47 req-e6b1f828-bb80-49d1-91ec-68b8a3c84988 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:03.114634 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fcc95ff4-c3db-47a3-b292-9bc1af8c0c47 req-e6b1f828-bb80-49d1-91ec-68b8a3c84988 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0475442 Nov 08 16:18:03.163489 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fcc95ff4-c3db-47a3-b292-9bc1af8c0c47 req-e8ad24ef-f217-455d-8021-6a84e777a09e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427606 Nov 08 16:18:03.791505 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c76686d1-1d3b-4a13-bdee-dc17893706ea req-e9c70075-6f48-4d9c-87db-1007b879827d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:03.792988 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c76686d1-1d3b-4a13-bdee-dc17893706ea req-e9c70075-6f48-4d9c-87db-1007b879827d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 943 time: 0.0530720 Nov 08 16:18:03.847841 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c76686d1-1d3b-4a13-bdee-dc17893706ea req-817829f4-724f-4857-883d-aa426accc498 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476518 Nov 08 16:18:04.282081 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-277a8e34-2774-404a-9bd5-d02afaf945af req-7db43c26-0841-402e-9db2-9e8b25edcfd0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:04.283842 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-277a8e34-2774-404a-9bd5-d02afaf945af req-7db43c26-0841-402e-9db2-9e8b25edcfd0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0492265 Nov 08 16:18:04.331173 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-277a8e34-2774-404a-9bd5-d02afaf945af req-7fbcdf14-8e3f-48b0-964c-0534ea5c7886 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412869 Nov 08 16:18:04.960664 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d221754d-b8e4-4882-8409-f5e20ce4f1f8 req-9363045e-aaee-436e-8305-ea86fa8dcd86 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:04.962185 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d221754d-b8e4-4882-8409-f5e20ce4f1f8 req-9363045e-aaee-436e-8305-ea86fa8dcd86 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 943 time: 0.0484130 Nov 08 16:18:05.016030 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d221754d-b8e4-4882-8409-f5e20ce4f1f8 req-790d7fd4-ce30-40c4-8620-63eaeb85d89a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479615 Nov 08 16:18:05.449789 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98389fb1-09cd-4804-b46b-5eadcdd05b71 req-ba4f4b0e-ef18-4ea4-bfe9-f9417044acb4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:05.451359 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-98389fb1-09cd-4804-b46b-5eadcdd05b71 req-ba4f4b0e-ef18-4ea4-bfe9-f9417044acb4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 943 time: 0.0487456 Nov 08 16:18:05.500293 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-98389fb1-09cd-4804-b46b-5eadcdd05b71 req-917da201-312e-4cdf-af58-3249514c24f8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427859 Nov 08 16:18:05.602189 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:18:05.880585 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 304e385a-c4e3-48f0-8723-230b5da69dc3 details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:18:05.969679 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 304e385a-c4e3-48f0-8723-230b5da69dc3, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=304e385a-c4e3-48f0-8723-230b5da69dc3,segment=NetworkSegment(1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3),segment_id=1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:18:05.980757 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': '304e385a-c4e3-48f0-8723-230b5da69dc3', 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837', 'port_id': '304e385a-c4e3-48f0-8723-230b5da69dc3', 'mac_address': 'fa:16:3e:c4:20:37', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 179, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '12999abd-2828-4905-aed0-938c2f27aed8', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:18:06.020580 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:06.033193 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 304e385a-c4e3-48f0-8723-230b5da69dc3 {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:18:06.051803 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 304e385a-c4e3-48f0-8723-230b5da69dc3, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=304e385a-c4e3-48f0-8723-230b5da69dc3,segment=NetworkSegment(1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3),segment_id=1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:18:06.056935 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:06.057632 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device fbefda08-fc7a-42a0-b714-6dea3d8a5161 details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:18:06.143949 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-660896aa-5044-466b-bb73-c5dd31dd6640 req-f5d9351f-6468-4237-b887-527b67696fb1 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:06.145433 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-660896aa-5044-466b-bb73-c5dd31dd6640 req-f5d9351f-6468-4237-b887-527b67696fb1 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 944 time: 0.0535052 Nov 08 16:18:06.147738 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=304e385a-c4e3-48f0-8723-230b5da69dc3,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:06.167437 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:18:06.167804 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:18:06.168317 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:18:06.168818 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:18:06.169154 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:18:06.169484 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:18:06.170751 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:18:06.170751 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:18:06.171004 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:18:06.171486 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:18:06.171973 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:18:06.172296 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:18:06.198344 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-660896aa-5044-466b-bb73-c5dd31dd6640 req-25b38143-d51d-46ae-bede-89d1f0daafc8 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431442 Nov 08 16:18:06.208810 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port fbefda08-fc7a-42a0-b714-6dea3d8a5161, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=fbefda08-fc7a-42a0-b714-6dea3d8a5161,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:18:06.230537 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': 'fbefda08-fc7a-42a0-b714-6dea3d8a5161', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'port_id': 'fbefda08-fc7a-42a0-b714-6dea3d8a5161', 'mac_address': 'fa:16:3e:13:3c:f6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 188, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:18:06.268764 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:06.281541 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fbefda08-fc7a-42a0-b714-6dea3d8a5161 {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:18:06.300367 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port fbefda08-fc7a-42a0-b714-6dea3d8a5161, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=fbefda08-fc7a-42a0-b714-6dea3d8a5161,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:18:06.303912 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:06.349620 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=fbefda08-fc7a-42a0-b714-6dea3d8a5161,revision_number=9']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:06.618806 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99892a44-1aff-4520-98f4-4953fe96208c req-f56cd0b1-cbdf-4801-8180-8f80c30e8475 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:06.620500 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-99892a44-1aff-4520-98f4-4953fe96208c req-f56cd0b1-cbdf-4801-8180-8f80c30e8475 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 944 time: 0.0501997 Nov 08 16:18:06.666825 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-99892a44-1aff-4520-98f4-4953fe96208c req-1d48ea6a-3c4b-4a19-bea7-a6afbe0f8994 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398409 Nov 08 16:18:06.762676 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['304e385a-c4e3-48f0-8723-230b5da69dc3'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:18:06.766412 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['fbefda08-fc7a-42a0-b714-6dea3d8a5161'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:18:07.323685 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d57a918-1317-4f5c-9a08-a161e1e1c9c0 req-42a4e708-ece7-4a29-9154-793f72e79c96 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:07.325919 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2d57a918-1317-4f5c-9a08-a161e1e1c9c0 req-42a4e708-ece7-4a29-9154-793f72e79c96 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 944 time: 0.0602012 Nov 08 16:18:07.381752 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2d57a918-1317-4f5c-9a08-a161e1e1c9c0 req-616e8eff-56e9-4471-80a5-62551e0ae113 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449326 Nov 08 16:18:07.623039 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 40386) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:18:07.725912 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-af2267a8-071b-49da-8e53-61abd7f6a0f7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:07.791064 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eee7214b-2c30-42c3-8bf5-723480860660 req-438d11eb-1046-4846-be0f-4b7443f9043c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:07.792540 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-eee7214b-2c30-42c3-8bf5-723480860660 req-438d11eb-1046-4846-be0f-4b7443f9043c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 944 time: 0.0542474 Nov 08 16:18:07.799854 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-af2267a8-071b-49da-8e53-61abd7f6a0f7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:07.804072 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-af2267a8-071b-49da-8e53-61abd7f6a0f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:07.839265 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-eee7214b-2c30-42c3-8bf5-723480860660 req-55369ae7-af28-4147-8b59-597dcd10deb6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407755 Nov 08 16:18:07.840103 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af2267a8-071b-49da-8e53-61abd7f6a0f7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bc719c04-080a-454f-ad3c-56370c069687,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:07.846236 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-af2267a8-071b-49da-8e53-61abd7f6a0f7 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=1785f09f99a842c2b61a31200fe7e282&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2205896 Nov 08 16:18:07.847943 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 40392) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:18:07.894326 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-297ab4b4-8a60-405c-8cb2-29eec60bdbf0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:07.901683 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 304e385a-c4e3-48f0-8723-230b5da69dc3 up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:18:07.914808 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-297ab4b4-8a60-405c-8cb2-29eec60bdbf0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:07.949566 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning for port 304e385a-c4e3-48f0-8723-230b5da69dc3 completed by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 16:18:07.953876 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port 304e385a-c4e3-48f0-8723-230b5da69dc3 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:18:07.954258 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:07.963241 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-297ab4b4-8a60-405c-8cb2-29eec60bdbf0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:07.965996 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-297ab4b4-8a60-405c-8cb2-29eec60bdbf0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:07.970345 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-297ab4b4-8a60-405c-8cb2-29eec60bdbf0 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/bc719c04-080a-454f-ad3c-56370c069687 HTTP/1.1" status: 204 len: 168 time: 0.1213455 Nov 08 16:18:07.977827 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-297ab4b4-8a60-405c-8cb2-29eec60bdbf0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bc719c04-080a-454f-ad3c-56370c069687,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:08.043266 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:08.069944 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '304e385a-c4e3-48f0-8723-230b5da69dc3'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:18:08.072137 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c881cf41-97b9-4110-acf4-3d1d0560241f" -d '{"events": [{"server_uuid": "4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912", "name": "network-vif-plugged", "status": "completed", "tag": "304e385a-c4e3-48f0-8723-230b5da69dc3"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:18:08.086094 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 304e385a-c4e3-48f0-8723-230b5da69dc3, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=304e385a-c4e3-48f0-8723-230b5da69dc3,segment=NetworkSegment(1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3),segment_id=1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:18:08.090939 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:08.092507 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device fbefda08-fc7a-42a0-b714-6dea3d8a5161 up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:18:08.115418 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:18:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e97512ad-1ed3-4c27-ad5a-36b6259937d5 x-openstack-request-id: req-e97512ad-1ed3-4c27-ad5a-36b6259937d5 {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:18:08.115630 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912", "name": "network-vif-plugged", "status": "completed", "tag": "304e385a-c4e3-48f0-8723-230b5da69dc3", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:18:08.115864 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-e97512ad-1ed3-4c27-ad5a-36b6259937d5 {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:18:08.116248 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '304e385a-c4e3-48f0-8723-230b5da69dc3', 'code': 200} Nov 08 16:18:08.167391 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-5c4bc836-abb8-4573-92c2-1d37db458994 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:08.194238 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=304e385a-c4e3-48f0-8723-230b5da69dc3,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:08.202605 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port fbefda08-fc7a-42a0-b714-6dea3d8a5161 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:18:08.202965 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:08.285403 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:08.296924 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1243fc7-4526-4f51-82bd-dc2defd29097 req-dfc609a7-0650-4f83-9c8f-bf1d236da923 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:08.298640 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d1243fc7-4526-4f51-82bd-dc2defd29097 req-dfc609a7-0650-4f83-9c8f-bf1d236da923 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 1098 time: 0.0417013 Nov 08 16:18:08.319076 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port fbefda08-fc7a-42a0-b714-6dea3d8a5161, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=fbefda08-fc7a-42a0-b714-6dea3d8a5161,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:18:08.323776 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:08.346636 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d1243fc7-4526-4f51-82bd-dc2defd29097 req-c03a03c0-0a34-42a4-98cc-19a6f71507c8 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397627 Nov 08 16:18:08.377192 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=fbefda08-fc7a-42a0-b714-6dea3d8a5161,revision_number=10']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:08.493729 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52670345-f5fe-4102-a449-92c7550a95df req-fd8ecb7f-0595-4486-8ad8-80fb8f042dd0 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:08.496416 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-52670345-f5fe-4102-a449-92c7550a95df req-fd8ecb7f-0595-4486-8ad8-80fb8f042dd0 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 945 time: 0.0498254 Nov 08 16:18:08.547815 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-52670345-f5fe-4102-a449-92c7550a95df req-e0660ab1-8de9-4f0a-9aa4-8d4ca0d65918 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455372 Nov 08 16:18:08.969161 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a6b8c0f-d904-45ff-bd2b-396c73fb206a req-0749544c-e8e4-4af6-b373-21024ea2573b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:08.970791 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3a6b8c0f-d904-45ff-bd2b-396c73fb206a req-0749544c-e8e4-4af6-b373-21024ea2573b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 946 time: 0.0493214 Nov 08 16:18:09.018331 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3a6b8c0f-d904-45ff-bd2b-396c73fb206a req-e175db95-931a-49ca-8365-171ac8b6bdc8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417111 Nov 08 16:18:09.662297 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e67da97c-e301-4601-b764-c21474381b77 req-cb437a80-ce42-4e98-b4d6-235ec0ed374c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:09.664605 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e67da97c-e301-4601-b764-c21474381b77 req-cb437a80-ce42-4e98-b4d6-235ec0ed374c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 945 time: 0.0517721 Nov 08 16:18:09.713569 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e67da97c-e301-4601-b764-c21474381b77 req-8f558406-10f1-48be-84a6-e6c066e87a6f tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422161 Nov 08 16:18:10.117582 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c1c8c8d-5f78-45fb-803d-8f7a84df3433', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fbefda08-fc7a-42a0-b714-6dea3d8a5161'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:18:10.120368 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4e59b39f-57d8-4243-ab6a-b4a5fb51b2c9" -d '{"events": [{"server_uuid": "1c1c8c8d-5f78-45fb-803d-8f7a84df3433", "name": "network-vif-plugged", "status": "completed", "tag": "fbefda08-fc7a-42a0-b714-6dea3d8a5161"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:18:10.141636 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff42677-f5dc-4909-b1a7-087aa7664197 req-37083374-aafc-4893-9016-6f4b50736938 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:10.143182 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9ff42677-f5dc-4909-b1a7-087aa7664197 req-37083374-aafc-4893-9016-6f4b50736938 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 946 time: 0.0515573 Nov 08 16:18:10.155272 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:18:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a82daf46-07bb-4faa-a41f-df67d3a5ee05 x-openstack-request-id: req-a82daf46-07bb-4faa-a41f-df67d3a5ee05 {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:18:10.155574 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1c1c8c8d-5f78-45fb-803d-8f7a84df3433", "name": "network-vif-plugged", "status": "completed", "tag": "fbefda08-fc7a-42a0-b714-6dea3d8a5161", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:18:10.155815 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-a82daf46-07bb-4faa-a41f-df67d3a5ee05 {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:18:10.156202 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c1c8c8d-5f78-45fb-803d-8f7a84df3433', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fbefda08-fc7a-42a0-b714-6dea3d8a5161', 'code': 200} Nov 08 16:18:10.191780 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9ff42677-f5dc-4909-b1a7-087aa7664197 req-dc311aeb-6028-47fc-898c-b9842e11a2fa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428078 Nov 08 16:18:10.587460 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-817ad29f-7b1f-47ca-bb3e-8029be6fa392 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:10.699418 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6b9b035-483a-42fb-b9f9-34ad98face7f req-435509b5-02dd-4af2-bd7b-7c46f9b27cd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:10.700871 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b6b9b035-483a-42fb-b9f9-34ad98face7f req-435509b5-02dd-4af2-bd7b-7c46f9b27cd1 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 1099 time: 0.0401106 Nov 08 16:18:10.746028 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b6b9b035-483a-42fb-b9f9-34ad98face7f req-6d2e4706-a107-483d-afd8-54fa4a5a9296 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0363255 Nov 08 16:18:10.827374 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae8bc26e-7c71-4794-ae97-b3d3a6324803 req-1b47739c-841d-4315-aaac-a7f009c45a9c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:10.828807 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ae8bc26e-7c71-4794-ae97-b3d3a6324803 req-1b47739c-841d-4315-aaac-a7f009c45a9c tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 945 time: 0.0471237 Nov 08 16:18:10.877474 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ae8bc26e-7c71-4794-ae97-b3d3a6324803 req-3f176cb6-340f-4f1e-8f01-9bb4cafa032d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428548 Nov 08 16:18:10.987055 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39f8537a-db72-4ba2-9a37-1a4d0767f76c req-d6cb6b48-f742-487e-8d5f-061759fe5560 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:10.988566 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-39f8537a-db72-4ba2-9a37-1a4d0767f76c req-d6cb6b48-f742-487e-8d5f-061759fe5560 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 945 time: 0.0478821 Nov 08 16:18:11.036535 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-39f8537a-db72-4ba2-9a37-1a4d0767f76c req-60a31e3f-760f-4e8b-9a39-f558f9478410 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421195 Nov 08 16:18:11.315528 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95827ef6-3924-4474-b53d-e9ee57ffc4db req-17173c24-1e9b-4140-afb7-b21b9fced8c9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:11.316993 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-95827ef6-3924-4474-b53d-e9ee57ffc4db req-17173c24-1e9b-4140-afb7-b21b9fced8c9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 946 time: 0.0493524 Nov 08 16:18:11.398078 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-652a011b-7a36-4b39-b5c8-5d26261ff8e2 req-d96f6202-cad3-445c-8dc0-55cbda1a8674 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:11.399580 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-652a011b-7a36-4b39-b5c8-5d26261ff8e2 req-d96f6202-cad3-445c-8dc0-55cbda1a8674 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 945 time: 0.0816367 Nov 08 16:18:11.403255 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-95827ef6-3924-4474-b53d-e9ee57ffc4db req-000da0da-00e5-446f-acdb-676c9b6001b7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0774140 Nov 08 16:18:11.449913 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-652a011b-7a36-4b39-b5c8-5d26261ff8e2 req-4c237741-6f80-45ab-b07c-8dd4a1028b75 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441520 Nov 08 16:18:11.542203 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:12.524138 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4784fc1e-5e78-4bfe-aaa9-513e8cd8a9d6 req-874688b5-8982-4325-bb12-2180450e1f04 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:12.525913 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4784fc1e-5e78-4bfe-aaa9-513e8cd8a9d6 req-874688b5-8982-4325-bb12-2180450e1f04 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 946 time: 0.0507622 Nov 08 16:18:12.578302 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4784fc1e-5e78-4bfe-aaa9-513e8cd8a9d6 req-24c9afd1-56a2-4848-9874-bfa7573a704d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456753 Nov 08 16:18:13.272350 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:13.698569 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aba2852-4c87-4166-8ead-e7b13280c5ab req-196cc4a9-0fe4-495e-9b57-45bd91454bad tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:13.699943 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5aba2852-4c87-4166-8ead-e7b13280c5ab req-196cc4a9-0fe4-495e-9b57-45bd91454bad tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 946 time: 0.0507498 Nov 08 16:18:13.745508 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5aba2852-4c87-4166-8ead-e7b13280c5ab req-cd79f12d-3d49-49cb-93c8-9c4aea13430c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397878 Nov 08 16:18:13.957464 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:15.866248 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 40610) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:18:15.966970 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6002a0ba-098b-434d-bd75-374ad64607af admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:16.042305 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6002a0ba-098b-434d-bd75-374ad64607af admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:16.046604 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6002a0ba-098b-434d-bd75-374ad64607af admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:16.083066 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6002a0ba-098b-434d-bd75-374ad64607af admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ac4ffbcb-97a2-4ed1-864c-531706dedc17,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:16.088649 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-6002a0ba-098b-434d-bd75-374ad64607af admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=a2aff3c74c214fdb89b0d2570b68b5ef&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2212808 Nov 08 16:18:16.091416 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 40616) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:18:16.133108 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40c2228c-2d87-4ed4-8a3a-13d6261808fb req-e0147224-c5b8-418f-b400-5fbe71947d1b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:16.134615 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-40c2228c-2d87-4ed4-8a3a-13d6261808fb req-e0147224-c5b8-418f-b400-5fbe71947d1b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 946 time: 0.0493410 Nov 08 16:18:16.139648 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-54b4eff4-6464-42a1-b517-27866896f00c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:16.161130 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-54b4eff4-6464-42a1-b517-27866896f00c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:16.182889 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-40c2228c-2d87-4ed4-8a3a-13d6261808fb req-052fa71a-ade3-4b2b-9862-e5ae40628c5d tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421720 Nov 08 16:18:16.207885 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-54b4eff4-6464-42a1-b517-27866896f00c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:16.210501 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-54b4eff4-6464-42a1-b517-27866896f00c admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:16.211629 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-54b4eff4-6464-42a1-b517-27866896f00c admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/ac4ffbcb-97a2-4ed1-864c-531706dedc17 HTTP/1.1" status: 204 len: 168 time: 0.1192966 Nov 08 16:18:16.219032 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54b4eff4-6464-42a1-b517-27866896f00c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ac4ffbcb-97a2-4ed1-864c-531706dedc17,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:16.460096 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 40624) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:18:16.475816 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1b0e7da2-921f-4aae-89f4-010a1ea434f2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:16.547869 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1b0e7da2-921f-4aae-89f4-010a1ea434f2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:16.551571 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1b0e7da2-921f-4aae-89f4-010a1ea434f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:16.588449 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-1b0e7da2-921f-4aae-89f4-010a1ea434f2 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=7b4baa32303f411eb17844e918c48278&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1273105 Nov 08 16:18:16.589601 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b0e7da2-921f-4aae-89f4-010a1ea434f2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=98492cd1-f217-4435-880b-0306f7182081,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:16.591177 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 40626) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:18:16.639325 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0833d528-6411-4d0a-9b83-f78703bdd02b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:16.659515 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0833d528-6411-4d0a-9b83-f78703bdd02b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:16.707595 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0833d528-6411-4d0a-9b83-f78703bdd02b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:16.710072 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-0833d528-6411-4d0a-9b83-f78703bdd02b admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:16.711176 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-0833d528-6411-4d0a-9b83-f78703bdd02b admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/98492cd1-f217-4435-880b-0306f7182081 HTTP/1.1" status: 204 len: 168 time: 0.1176615 Nov 08 16:18:16.719384 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0833d528-6411-4d0a-9b83-f78703bdd02b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=98492cd1-f217-4435-880b-0306f7182081,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:17.014951 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 40632) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:18:17.027717 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f3d4194f-8483-45c8-8cf2-312b91cfdd0f admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:17.099359 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f3d4194f-8483-45c8-8cf2-312b91cfdd0f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:17.102909 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f3d4194f-8483-45c8-8cf2-312b91cfdd0f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:17.146033 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-f3d4194f-8483-45c8-8cf2-312b91cfdd0f admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=48048c12b4db4894a6f8d2d5de5ebaea&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1299727 Nov 08 16:18:17.147103 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3d4194f-8483-45c8-8cf2-312b91cfdd0f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=94149584-d531-4a5d-b864-2db9cbc0eb15,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:17.148693 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 40634) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:18:17.196575 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6b46e866-52a8-4fa9-8490-3f6f5aa6f7aa admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:17.218351 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6b46e866-52a8-4fa9-8490-3f6f5aa6f7aa admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:17.264648 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6b46e866-52a8-4fa9-8490-3f6f5aa6f7aa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:17.267331 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6b46e866-52a8-4fa9-8490-3f6f5aa6f7aa admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:17.268475 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-6b46e866-52a8-4fa9-8490-3f6f5aa6f7aa admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/94149584-d531-4a5d-b864-2db9cbc0eb15 HTTP/1.1" status: 204 len: 168 time: 0.1179647 Nov 08 16:18:17.276160 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b46e866-52a8-4fa9-8490-3f6f5aa6f7aa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=94149584-d531-4a5d-b864-2db9cbc0eb15,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:17.314543 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23868b40-9fb6-406d-a599-2f60d0ce35a6 req-4dae14a4-2fec-4781-98a9-6df31839a69e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:17.316013 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-23868b40-9fb6-406d-a599-2f60d0ce35a6 req-4dae14a4-2fec-4781-98a9-6df31839a69e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 946 time: 0.0596375 Nov 08 16:18:17.364626 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-23868b40-9fb6-406d-a599-2f60d0ce35a6 req-fae83a69-6659-44c0-b389-744f6b5faa4a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424500 Nov 08 16:18:17.953385 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:18.098958 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f02192ca-93c4-4215-97f3-6671a4c6d98b req-d4f81c3b-8848-4931-a944-2dea9a1ef859 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:18.100397 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f02192ca-93c4-4215-97f3-6671a4c6d98b req-d4f81c3b-8848-4931-a944-2dea9a1ef859 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.25 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 946 time: 0.0514638 Nov 08 16:18:18.188495 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-f02192ca-93c4-4215-97f3-6671a4c6d98b req-ce480d57-cf48-40ea-ba5b-ee73f2e082ea tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Deleting port 17d7004d-111e-4cfc-904c-a17ed005bc2f {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:18:18.189185 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-f02192ca-93c4-4215-97f3-6671a4c6d98b req-ce480d57-cf48-40ea-ba5b-ee73f2e082ea tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:18.277688 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-f02192ca-93c4-4215-97f3-6671a4c6d98b req-ce480d57-cf48-40ea-ba5b-ee73f2e082ea tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] For port 17d7004d-111e-4cfc-904c-a17ed005bc2f, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=17d7004d-111e-4cfc-904c-a17ed005bc2f,segment=NetworkSegment(1383b9f8-d178-4a90-828c-184fa1886253),segment_id=1383b9f8-d178-4a90-828c-184fa1886253)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:18:18.278069 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-f02192ca-93c4-4215-97f3-6671a4c6d98b req-ce480d57-cf48-40ea-ba5b-ee73f2e082ea tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:18.295515 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-bc7d14bf-fa18-408a-8edb-c9ebda6bd8df req-d6f0761b-bd3a-4720-bdc7-b4ea810cd669 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0397539 Nov 08 16:18:18.355788 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc7d14bf-fa18-408a-8edb-c9ebda6bd8df req-28c009fd-2626-4591-afb1-2070eaf4373c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:18.357830 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-bc7d14bf-fa18-408a-8edb-c9ebda6bd8df req-28c009fd-2626-4591-afb1-2070eaf4373c service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=f6e779f0506643d08d984c2971d5a71c&device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 1098 time: 0.0387018 Nov 08 16:18:18.465839 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc7d14bf-fa18-408a-8edb-c9ebda6bd8df req-fe019cf2-9c00-46eb-804b-1f903a9c0a34 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:18.467813 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-bc7d14bf-fa18-408a-8edb-c9ebda6bd8df req-fe019cf2-9c00-46eb-804b-1f903a9c0a34 service neutron] 10.222.0.25 "GET /v2.0/networks?id=75fa9c3e-7bfe-490a-9118-221394c29646 HTTP/1.1" status: 200 len: 911 time: 0.0863028 Nov 08 16:18:18.542723 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-bc7d14bf-fa18-408a-8edb-c9ebda6bd8df req-0462e7d9-1d3e-4642-83c2-dcf07574a0cc service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f4784d76-6af7-4b31-a9f3-ee25c9087b51 HTTP/1.1" status: 200 len: 1000 time: 0.0653341 Nov 08 16:18:18.595991 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc7d14bf-fa18-408a-8edb-c9ebda6bd8df req-219af87f-691e-46e4-bd36-d5e7a5b2ab67 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:18.597446 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-bc7d14bf-fa18-408a-8edb-c9ebda6bd8df req-219af87f-691e-46e4-bd36-d5e7a5b2ab67 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=8b248e51-4c70-4980-9452-c6b625bf96dd HTTP/1.1" status: 200 len: 849 time: 0.0451145 Nov 08 16:18:18.644309 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc7d14bf-fa18-408a-8edb-c9ebda6bd8df req-4f2ab749-2415-412c-acb7-80574d6a046d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:18.645962 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-bc7d14bf-fa18-408a-8edb-c9ebda6bd8df req-4f2ab749-2415-412c-acb7-80574d6a046d service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=75fa9c3e-7bfe-490a-9118-221394c29646&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0396442 Nov 08 16:18:18.726669 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13c8bc82-d578-4e6c-989d-dd82ed7998a4 req-620aa4fe-10d9-46e0-9267-995444a79dce tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:18.728146 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-13c8bc82-d578-4e6c-989d-dd82ed7998a4 req-620aa4fe-10d9-46e0-9267-995444a79dce tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 946 time: 0.1204824 Nov 08 16:18:18.738112 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-bc7d14bf-fa18-408a-8edb-c9ebda6bd8df req-caf7501a-0f5d-4db5-b549-3f051493500a service neutron] 10.222.0.25 "GET /v2.0/networks/75fa9c3e-7bfe-490a-9118-221394c29646?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0831320 Nov 08 16:18:18.762022 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-f02192ca-93c4-4215-97f3-6671a4c6d98b req-ce480d57-cf48-40ea-ba5b-ee73f2e082ea tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:18.762386 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-f02192ca-93c4-4215-97f3-6671a4c6d98b req-ce480d57-cf48-40ea-ba5b-ee73f2e082ea tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-2032271'] for floatingip, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:18.762697 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.db.l3_db [req-f02192ca-93c4-4215-97f3-6671a4c6d98b req-ce480d57-cf48-40ea-ba5b-ee73f2e082ea tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Floating IP a86b2433-a749-44fc-91a7-e9bec1465b20 disassociated. External IP: 172.27.3.215, port: 17d7004d-111e-4cfc-904c-a17ed005bc2f. Nov 08 16:18:18.763058 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-f02192ca-93c4-4215-97f3-6671a4c6d98b req-ce480d57-cf48-40ea-ba5b-ee73f2e082ea tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling delete_port for 17d7004d-111e-4cfc-904c-a17ed005bc2f owned by compute:nova {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:18:18.828105 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-bc7d14bf-fa18-408a-8edb-c9ebda6bd8df req-31a8fe8b-2eba-4bb8-bf8f-26e799c78fef service neutron] 10.222.0.25 "GET /v2.0/networks/75fa9c3e-7bfe-490a-9118-221394c29646?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0789378 Nov 08 16:18:18.829231 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-13c8bc82-d578-4e6c-989d-dd82ed7998a4 req-5390f553-b810-484c-a3a6-0cd486b9719b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0926976 Nov 08 16:18:18.913522 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-f02192ca-93c4-4215-97f3-6671a4c6d98b req-ce480d57-cf48-40ea-ba5b-ee73f2e082ea tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:18.939435 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce480d57-cf48-40ea-ba5b-ee73f2e082ea tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Pushing event deleted for resources: {'Port': ['ID=17d7004d-111e-4cfc-904c-a17ed005bc2f,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:19.051201 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.l3_agent_scheduler [req-f02192ca-93c4-4215-97f3-6671a4c6d98b req-ce480d57-cf48-40ea-ba5b-ee73f2e082ea tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Router f80d01f3-bee2-4682-8f4a-92536ad96209 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:18:19.157204 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-f02192ca-93c4-4215-97f3-6671a4c6d98b req-ce480d57-cf48-40ea-ba5b-ee73f2e082ea tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:18:19.167860 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63d6c7b1-9cca-4bac-b3fa-4aa814d71298 None None] Sync routers for ids ['f80d01f3-bee2-4682-8f4a-92536ad96209'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:18:19.178764 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63d6c7b1-9cca-4bac-b3fa-4aa814d71298 None None] Routers {'f80d01f3-bee2-4682-8f4a-92536ad96209'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:18:19.179590 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-63d6c7b1-9cca-4bac-b3fa-4aa814d71298 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:18:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['f80d01f3-bee2-4682-8f4a-92536ad96209'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:18:19.194739 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-f02192ca-93c4-4215-97f3-6671a4c6d98b req-ce480d57-cf48-40ea-ba5b-ee73f2e082ea tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] No DVR routers for this DVR port 17d7004d-111e-4cfc-904c-a17ed005bc2f on host hv-cinder-81618 {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:18:19.197780 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-f02192ca-93c4-4215-97f3-6671a4c6d98b req-ce480d57-cf48-40ea-ba5b-ee73f2e082ea tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:19.201861 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f02192ca-93c4-4215-97f3-6671a4c6d98b req-ce480d57-cf48-40ea-ba5b-ee73f2e082ea tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.25 "DELETE /v2.0/ports/17d7004d-111e-4cfc-904c-a17ed005bc2f HTTP/1.1" status: 204 len: 173 time: 1.0944967 Nov 08 16:18:19.202313 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd643b8f8-c205-49ba-8889-30842481b95f', 'name': 'network-vif-deleted', 'tag': '17d7004d-111e-4cfc-904c-a17ed005bc2f'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:18:19.204606 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-810b2e9b-0d40-47bb-a2ce-42aaa6292629" -d '{"events": [{"server_uuid": "d643b8f8-c205-49ba-8889-30842481b95f", "name": "network-vif-deleted", "tag": "17d7004d-111e-4cfc-904c-a17ed005bc2f"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:18:19.253640 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:18:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1014c9d9-820b-4f5e-a650-bf97f0274830 x-openstack-request-id: req-1014c9d9-820b-4f5e-a650-bf97f0274830 {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:18:19.253990 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d643b8f8-c205-49ba-8889-30842481b95f", "name": "network-vif-deleted", "tag": "17d7004d-111e-4cfc-904c-a17ed005bc2f", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:18:19.255261 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-1014c9d9-820b-4f5e-a650-bf97f0274830 {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:18:19.256230 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd643b8f8-c205-49ba-8889-30842481b95f', 'name': 'network-vif-deleted', 'tag': '17d7004d-111e-4cfc-904c-a17ed005bc2f', 'status': 'completed', 'code': 200} Nov 08 16:18:19.287415 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-63d6c7b1-9cca-4bac-b3fa-4aa814d71298 None None] Set router f80d01f3-bee2-4682-8f4a-92536ad96209 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:18:19.484359 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-63d6c7b1-9cca-4bac-b3fa-4aa814d71298 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 4, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': 'dbdf39d9-310f-42ea-a1f1-4e1b15048b73', 'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'mac_address': 'fa:16:3e:13:ec:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_interface', 'standard_attr_id': 228, 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:28Z', 'updated_at': '2021-11-08T16:12:32Z', 'revision_number': 5, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'subnets': [{'id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:18:19.510755 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63d6c7b1-9cca-4bac-b3fa-4aa814d71298 None None] Checking router: f80d01f3-bee2-4682-8f4a-92536ad96209 for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:18:19.519520 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63d6c7b1-9cca-4bac-b3fa-4aa814d71298 None None] Routers {'f80d01f3-bee2-4682-8f4a-92536ad96209'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:18:19.520170 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-63d6c7b1-9cca-4bac-b3fa-4aa814d71298 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:18:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['f80d01f3-bee2-4682-8f4a-92536ad96209'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:18:19.628355 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-63d6c7b1-9cca-4bac-b3fa-4aa814d71298 None None] Set router f80d01f3-bee2-4682-8f4a-92536ad96209 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:18:19.823811 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-63d6c7b1-9cca-4bac-b3fa-4aa814d71298 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 4, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': 'dbdf39d9-310f-42ea-a1f1-4e1b15048b73', 'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'mac_address': 'fa:16:3e:13:ec:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_interface', 'standard_attr_id': 228, 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:28Z', 'updated_at': '2021-11-08T16:12:32Z', 'revision_number': 5, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'subnets': [{'id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:18:19.852841 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63d6c7b1-9cca-4bac-b3fa-4aa814d71298 None None] The sync data for ids ['f80d01f3-bee2-4682-8f4a-92536ad96209'] in dv-cinder-816187-2-iscsi is: [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 4, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': 'dbdf39d9-310f-42ea-a1f1-4e1b15048b73', 'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'mac_address': 'fa:16:3e:13:ec:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_interface', 'standard_attr_id': 228, 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:28Z', 'updated_at': '2021-11-08T16:12:32Z', 'revision_number': 5, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'subnets': [{'id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:18:19.945070 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d045a7a4-f93a-401a-aef8-26f0b702b815 req-dfe316b6-b15e-4ece-a57e-641d8b9c98e9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=d643b8f8-c205-49ba-8889-30842481b95f HTTP/1.1" status: 200 len: 210 time: 0.0293772 Nov 08 16:18:20.085586 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-427e3cec-1105-4bdf-b974-4d3a15e86601 None None] New status for floating IP a86b2433-a749-44fc-91a7-e9bec1465b20: DOWN {{(pid=101247) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 16:18:20.876851 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2309cf4-6e7e-4e88-8727-79a8411dfec8 req-b4b822a2-6fb2-41de-b974-2ed93490a248 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:20.878503 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a2309cf4-6e7e-4e88-8727-79a8411dfec8 req-b4b822a2-6fb2-41de-b974-2ed93490a248 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 945 time: 0.0517824 Nov 08 16:18:20.931851 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a2309cf4-6e7e-4e88-8727-79a8411dfec8 req-778e2e93-faf6-4dc0-8a73-efe870b7983f tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465295 Nov 08 16:18:20.954638 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 40662) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:18:21.199089 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e04a1b11-b382-4878-bf1e-895a9d4110ff tempest-TestMinimumBasicScenario-617580179 tempest-TestMinimumBasicScenario-617580179-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:21.201747 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-e04a1b11-b382-4878-bf1e-895a9d4110ff tempest-TestMinimumBasicScenario-617580179 tempest-TestMinimumBasicScenario-617580179-project-admin] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 1093 time: 0.2456253 Nov 08 16:18:21.204146 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 40674) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:18:21.212404 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-6d249bd8-42bd-4ac8-809a-6b817ab5962b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Request body: {'floatingip': {'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'port_id': '304e385a-c4e3-48f0-8723-230b5da69dc3', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'fixed_ip_address': '172.20.0.5'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:18:21.223130 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-d76de656-274e-4a48-b1a1-bee6d31e9db3 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-706634952&fields=id&tenant_id=343d5ca096394f87bea0950aa3811a13 HTTP/1.1" status: 200 len: 267 time: 0.0569904 Nov 08 16:18:21.254472 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6d249bd8-42bd-4ac8-809a-6b817ab5962b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for floatingip, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:21.374701 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-82be3871-b427-4fba-a4e5-57f00ec85399 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:21.376113 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-82be3871-b427-4fba-a4e5-57f00ec85399 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/networks?id=a15e051b-c130-4140-aaf2-a45ea7af5b43 HTTP/1.1" status: 200 len: 812 time: 0.1453266 Nov 08 16:18:21.393897 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-d3f2bb8e-0258-4bed-ba44-e993bcae8ccc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/quotas/343d5ca096394f87bea0950aa3811a13 HTTP/1.1" status: 200 len: 375 time: 0.0115159 Nov 08 16:18:21.451693 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6d249bd8-42bd-4ac8-809a-6b817ab5962b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:21.465775 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-620c2b9d-297d-42be-a70f-8ec12781a418 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?tenant_id=343d5ca096394f87bea0950aa3811a13&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0636640 Nov 08 16:18:21.639344 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [None req-6d249bd8-42bd-4ac8-809a-6b817ab5962b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Allocated IP 172.27.3.193 (68f46265-b42a-49a0-8d57-f9362045cd9b/4728e4be-5a19-43c0-89cf-ced2a190645d/2d5c2aab-de16-4ae7-a212-4e4444dfd64f) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:18:21.642839 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-e1f0b6e5-29d0-4d1c-af0e-3e1d1b5b4d37 service neutron] 10.222.0.37 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1437051 Nov 08 16:18:21.798306 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-8f8597f4-7db8-4b02-a22d-ba5e3ddbcd1b service neutron] 10.222.0.37 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1464984 Nov 08 16:18:21.812722 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6d249bd8-42bd-4ac8-809a-6b817ab5962b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:21.846603 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6d249bd8-42bd-4ac8-809a-6b817ab5962b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:21.884196 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d249bd8-42bd-4ac8-809a-6b817ab5962b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Network 68f46265-b42a-49a0-8d57-f9362045cd9b is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:18:21.889129 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-6d249bd8-42bd-4ac8-809a-6b817ab5962b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:18:21.892602 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d249bd8-42bd-4ac8-809a-6b817ab5962b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:18:21.914133 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d249bd8-42bd-4ac8-809a-6b817ab5962b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Pushing event updated for resources: {'Port': ['ID=2d5c2aab-de16-4ae7-a212-4e4444dfd64f,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:22.116176 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 17d7004d-111e-4cfc-904c-a17ed005bc2f no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:18:22.128296 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-38d62322-bb1b-40d4-b373-c7cf8d6fa7e4 req-ab31ecfe-b599-4c3f-a1d5-7e6dd774a32a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 210 time: 0.0347757 Nov 08 16:18:22.137013 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] No Port match for: 17d7004d-111e-4cfc-904c-a17ed005bc2f {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:18:22.137376 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 17d7004d-111e-4cfc-904c-a17ed005bc2f not bound to the agent host hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:18:22.300369 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6d249bd8-42bd-4ac8-809a-6b817ab5962b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:22.367216 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6d249bd8-42bd-4ac8-809a-6b817ab5962b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:22.516694 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6d249bd8-42bd-4ac8-809a-6b817ab5962b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:22.521180 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6d249bd8-42bd-4ac8-809a-6b817ab5962b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:22.587639 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d249bd8-42bd-4ac8-809a-6b817ab5962b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Pushing event updated for resources: {'Port': ['ID=2d5c2aab-de16-4ae7-a212-4e4444dfd64f,revision_number=2']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:22.603973 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6d249bd8-42bd-4ac8-809a-6b817ab5962b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-2032271'] for floatingip, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:22.718687 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.db.l3_db [None req-6d249bd8-42bd-4ac8-809a-6b817ab5962b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Floating IP 118c0941-b7aa-470c-a5b1-6341e4cd967c associated. External IP: 172.27.3.193, port: 304e385a-c4e3-48f0-8723-230b5da69dc3. Nov 08 16:18:23.250831 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-86564482-038e-4b31-9626-606b5e6c7054 req-e273e13a-ba76-4657-8e71-e5bfe7e06c37 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 210 time: 0.0398715 Nov 08 16:18:23.258496 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-0dedb709-6930-4102-b758-998a860ce86c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:23.259803 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-0dedb709-6930-4102-b758-998a860ce86c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.25 "GET /v2.0/networks?id=a15e051b-c130-4140-aaf2-a45ea7af5b43 HTTP/1.1" status: 200 len: 812 time: 0.1834240 Nov 08 16:18:23.264565 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6d249bd8-42bd-4ac8-809a-6b817ab5962b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Router 3aa8420d-7378-4033-af1d-6dae369fd742 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:18:23.407042 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-c9115adf-47f2-4272-889f-a5d83ba58054 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.25 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=343d5ca096394f87bea0950aa3811a13 HTTP/1.1" status: 200 len: 379 time: 0.1012018 Nov 08 16:18:23.418713 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-9bc0c647-8150-4bbb-8b76-8b127a74466a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Request body: {'port': {'device_id': '5ce49cb3-8d64-40a5-9827-64fa1d2f37c2', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'admin_state_up': True, 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'security_groups': ['a52bd5f6-4026-4f07-a3d9-c70ec9af4076']}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:18:23.424123 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6d249bd8-42bd-4ac8-809a-6b817ab5962b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:18:23.433822 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de3df362-162c-433e-b92d-faea5c618f93 None None] Sync routers for ids ['3aa8420d-7378-4033-af1d-6dae369fd742'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:18:23.443989 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de3df362-162c-433e-b92d-faea5c618f93 None None] Routers {'3aa8420d-7378-4033-af1d-6dae369fd742'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:18:23.444737 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-de3df362-162c-433e-b92d-faea5c618f93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:18:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['3aa8420d-7378-4033-af1d-6dae369fd742'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:18:23.482151 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6d249bd8-42bd-4ac8-809a-6b817ab5962b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for floatingip, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:23.524889 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-6d249bd8-42bd-4ac8-809a-6b817ab5962b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.3196740 Nov 08 16:18:23.527962 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912', 'tag': '304e385a-c4e3-48f0-8723-230b5da69dc3'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:18:23.528890 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 40694) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:18:23.534291 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6178af08-179f-4ea3-ad2d-1e442c4e62f3" -d '{"events": [{"name": "network-changed", "server_uuid": "4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912", "tag": "304e385a-c4e3-48f0-8723-230b5da69dc3"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:18:23.534748 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-ce5c5dd7-907c-4365-85d6-f74d677d15c6 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-265532524', 'description': 'tempest-secgroup-smoke-265532524 description', 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:18:23.562721 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-de3df362-162c-433e-b92d-faea5c618f93 None None] Set router 3aa8420d-7378-4033-af1d-6dae369fd742 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:18:23.564863 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ce5c5dd7-907c-4365-85d6-f74d677d15c6 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:23.594106 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:18:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-28fd891e-4f65-4730-aa15-e0bfdef1457a x-openstack-request-id: req-28fd891e-4f65-4730-aa15-e0bfdef1457a {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:18:23.594452 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912", "tag": "304e385a-c4e3-48f0-8723-230b5da69dc3", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:18:23.594741 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-28fd891e-4f65-4730-aa15-e0bfdef1457a {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:18:23.595174 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912', 'tag': '304e385a-c4e3-48f0-8723-230b5da69dc3', 'status': 'completed', 'code': 200} Nov 08 16:18:23.611070 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-9bc0c647-8150-4bbb-8b76-8b127a74466a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Made reservation on behalf of 343d5ca096394f87bea0950aa3811a13 for: {'port': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:18:23.614755 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-9bc0c647-8150-4bbb-8b76-8b127a74466a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:23.693038 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6178af08-179f-4ea3-ad2d-1e442c4e62f3 req-cc2591af-8806-43c3-82c9-97244432029b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:23.694749 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-6178af08-179f-4ea3-ad2d-1e442c4e62f3 req-cc2591af-8806-43c3-82c9-97244432029b service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=9ad6e5c060034b2ca263bfdcb07fe807&device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 1098 time: 0.0711443 Nov 08 16:18:23.706455 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ce5c5dd7-907c-4365-85d6-f74d677d15c6 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:23.713219 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ce5c5dd7-907c-4365-85d6-f74d677d15c6 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:23.784236 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-9bc0c647-8150-4bbb-8b76-8b127a74466a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Allocated IP 172.20.0.9 (a15e051b-c130-4140-aaf2-a45ea7af5b43/6e4d65b1-4f2c-453a-847c-970dff985732/794847db-0663-47ab-a2b0-4bdedb698598) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:18:23.802355 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ce5c5dd7-907c-4365-85d6-f74d677d15c6 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:23.806647 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-ce5c5dd7-907c-4365-85d6-f74d677d15c6 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.2757583 Nov 08 16:18:23.810020 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 40698) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:18:23.810949 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce5c5dd7-907c-4365-85d6-f74d677d15c6 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1d27de4f-b93c-4054-9b9d-62a7c87a8620,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:23.814508 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-d9696096-d741-4625-ab8f-3c35019722e4 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Request body: {'security_group_rule': {'security_group_id': '1d27de4f-b93c-4054-9b9d-62a7c87a8620', 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:18:23.864309 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6178af08-179f-4ea3-ad2d-1e442c4e62f3 req-b1f47636-e4d8-449f-bc95-b41799bf96ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:23.865827 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-6178af08-179f-4ea3-ad2d-1e442c4e62f3 req-b1f47636-e4d8-449f-bc95-b41799bf96ed service neutron] 10.222.0.25 "GET /v2.0/networks?id=52eb1d65-dc7c-45c5-9521-97cb18715837 HTTP/1.1" status: 200 len: 915 time: 0.1379240 Nov 08 16:18:23.904567 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d9696096-d741-4625-ab8f-3c35019722e4 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:23.913417 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-de3df362-162c-433e-b92d-faea5c618f93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'name': 'tempest-TestMinimumBasicScenario-138746869-router', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148'}], 'enable_snat': True}, 'gw_port_id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:17:03Z', 'updated_at': '2021-11-08T16:17:07Z', 'revision_number': 4, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'gw_port': {'id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:1c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:04Z', 'updated_at': '2021-11-08T16:17:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': '118c0941-b7aa-470c-a5b1-6341e4cd967c', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'floating_ip_address': '172.27.3.193', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'port_id': '304e385a-c4e3-48f0-8723-230b5da69dc3', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 524, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837', 'mac_address': 'fa:16:3e:c4:20:37', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:18:22Z', 'updated_at': '2021-11-08T16:18:22Z', 'revision_number': 0, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1530a0fe-3181-4905-89a0-9606e9ca5a5f', 'name': '', 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'mac_address': 'fa:16:3e:20:1e:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'device_owner': 'network:router_interface', 'standard_attr_id': 479, 'fixed_ips': [{'subnet_id': '12999abd-2828-4905-aed0-938c2f27aed8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:06Z', 'updated_at': '2021-11-08T16:17:13Z', 'revision_number': 5, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'subnets': [{'id': '12999abd-2828-4905-aed0-938c2f27aed8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:18:23.942908 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de3df362-162c-433e-b92d-faea5c618f93 None None] Checking router: 3aa8420d-7378-4033-af1d-6dae369fd742 for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:18:23.944433 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-6178af08-179f-4ea3-ad2d-1e442c4e62f3 req-9e1fc2d7-ee6c-4339-b0f3-0f82c040f211 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=304e385a-c4e3-48f0-8723-230b5da69dc3 HTTP/1.1" status: 200 len: 999 time: 0.0685990 Nov 08 16:18:23.953870 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de3df362-162c-433e-b92d-faea5c618f93 None None] Routers {'3aa8420d-7378-4033-af1d-6dae369fd742'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:18:23.954491 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-de3df362-162c-433e-b92d-faea5c618f93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:18:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['3aa8420d-7378-4033-af1d-6dae369fd742'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:18:23.992471 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-9bc0c647-8150-4bbb-8b76-8b127a74466a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:23.999897 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6178af08-179f-4ea3-ad2d-1e442c4e62f3 req-88422f36-2e19-460f-87d6-946decc3c855 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:24.003091 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-6178af08-179f-4ea3-ad2d-1e442c4e62f3 req-88422f36-2e19-460f-87d6-946decc3c855 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=12999abd-2828-4905-aed0-938c2f27aed8 HTTP/1.1" status: 200 len: 853 time: 0.0513949 Nov 08 16:18:24.004251 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d9696096-d741-4625-ab8f-3c35019722e4 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.010012 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d9696096-d741-4625-ab8f-3c35019722e4 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.032745 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9696096-d741-4625-ab8f-3c35019722e4 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0c377827-f4fb-40fb-89c7-bf336383ed17,revision_number=0']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:24.047101 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d9696096-d741-4625-ab8f-3c35019722e4 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.050246 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-d9696096-d741-4625-ab8f-3c35019722e4 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2401445 Nov 08 16:18:24.051269 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 40700) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:18:24.056472 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-62c6570d-2e50-4fc4-872c-a78927e2c368 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Request body: {'security_group_rule': {'security_group_id': '1d27de4f-b93c-4054-9b9d-62a7c87a8620', 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:18:24.062365 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6178af08-179f-4ea3-ad2d-1e442c4e62f3 req-015986db-3bec-4327-ac1a-cc5260d0ac4c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:24.063801 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-6178af08-179f-4ea3-ad2d-1e442c4e62f3 req-015986db-3bec-4327-ac1a-cc5260d0ac4c service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=52eb1d65-dc7c-45c5-9521-97cb18715837&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0528269 Nov 08 16:18:24.069919 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-de3df362-162c-433e-b92d-faea5c618f93 None None] Set router 3aa8420d-7378-4033-af1d-6dae369fd742 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:18:24.073676 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-9bc0c647-8150-4bbb-8b76-8b127a74466a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.123505 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-9bc0c647-8150-4bbb-8b76-8b127a74466a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Network a15e051b-c130-4140-aaf2-a45ea7af5b43 is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:18:24.130728 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-9bc0c647-8150-4bbb-8b76-8b127a74466a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:18:24.133996 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-62c6570d-2e50-4fc4-872c-a78927e2c368 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.136565 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-9bc0c647-8150-4bbb-8b76-8b127a74466a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:18:24.145302 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bc0c647-8150-4bbb-8b76-8b127a74466a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Pushing event updated for resources: {'Port': ['ID=794847db-0663-47ab-a2b0-4bdedb698598,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:24.206733 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-6178af08-179f-4ea3-ad2d-1e442c4e62f3 req-e532e26c-7dd4-48eb-a17c-bf9cdd4531de service neutron] 10.222.0.25 "GET /v2.0/networks/52eb1d65-dc7c-45c5-9521-97cb18715837?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1324544 Nov 08 16:18:24.210822 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-9bc0c647-8150-4bbb-8b76-8b127a74466a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:24.211588 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-9bc0c647-8150-4bbb-8b76-8b127a74466a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.222606 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-62c6570d-2e50-4fc4-872c-a78927e2c368 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.231125 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-62c6570d-2e50-4fc4-872c-a78927e2c368 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.234522 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-9bc0c647-8150-4bbb-8b76-8b127a74466a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8197403 Nov 08 16:18:24.254028 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-f10f27f8-4429-4dcb-9259-60a8f351b00e service neutron] Request body: {'port': {'device_id': '5ce49cb3-8d64-40a5-9827-64fa1d2f37c2', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81618'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:18:24.303361 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62c6570d-2e50-4fc4-872c-a78927e2c368 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=78f0dcdf-0d7b-43d8-9d9e-f4eb9f818285,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:24.313312 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-62c6570d-2e50-4fc4-872c-a78927e2c368 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.314515 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-62c6570d-2e50-4fc4-872c-a78927e2c368 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2616200 Nov 08 16:18:24.317233 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 40704) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:18:24.321506 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-113eba03-b56f-49ec-867d-1d2486f9d2f5 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Request body: {'security_group_rule': {'security_group_id': '1d27de4f-b93c-4054-9b9d-62a7c87a8620', 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:18:24.361269 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-f10f27f8-4429-4dcb-9259-60a8f351b00e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.373091 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-de3df362-162c-433e-b92d-faea5c618f93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'name': 'tempest-TestMinimumBasicScenario-138746869-router', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148'}], 'enable_snat': True}, 'gw_port_id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:17:03Z', 'updated_at': '2021-11-08T16:17:07Z', 'revision_number': 4, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'gw_port': {'id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:1c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:04Z', 'updated_at': '2021-11-08T16:17:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': '118c0941-b7aa-470c-a5b1-6341e4cd967c', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'floating_ip_address': '172.27.3.193', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'port_id': '304e385a-c4e3-48f0-8723-230b5da69dc3', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 524, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837', 'mac_address': 'fa:16:3e:c4:20:37', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:18:22Z', 'updated_at': '2021-11-08T16:18:22Z', 'revision_number': 0, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1530a0fe-3181-4905-89a0-9606e9ca5a5f', 'name': '', 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'mac_address': 'fa:16:3e:20:1e:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'device_owner': 'network:router_interface', 'standard_attr_id': 479, 'fixed_ips': [{'subnet_id': '12999abd-2828-4905-aed0-938c2f27aed8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:06Z', 'updated_at': '2021-11-08T16:17:13Z', 'revision_number': 5, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'subnets': [{'id': '12999abd-2828-4905-aed0-938c2f27aed8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:18:24.374604 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-6178af08-179f-4ea3-ad2d-1e442c4e62f3 req-06f64166-bf98-4b9a-8034-5b590fd26932 service neutron] 10.222.0.25 "GET /v2.0/networks/52eb1d65-dc7c-45c5-9521-97cb18715837?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1540165 Nov 08 16:18:24.383493 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-113eba03-b56f-49ec-867d-1d2486f9d2f5 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.408777 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de3df362-162c-433e-b92d-faea5c618f93 None None] The sync data for ids ['3aa8420d-7378-4033-af1d-6dae369fd742'] in dv-cinder-816187-2-iscsi is: [{'id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'name': 'tempest-TestMinimumBasicScenario-138746869-router', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148'}], 'enable_snat': True}, 'gw_port_id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:17:03Z', 'updated_at': '2021-11-08T16:17:07Z', 'revision_number': 4, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'gw_port': {'id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:1c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:04Z', 'updated_at': '2021-11-08T16:17:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': '118c0941-b7aa-470c-a5b1-6341e4cd967c', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'floating_ip_address': '172.27.3.193', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'port_id': '304e385a-c4e3-48f0-8723-230b5da69dc3', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 524, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837', 'mac_address': 'fa:16:3e:c4:20:37', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:18:22Z', 'updated_at': '2021-11-08T16:18:22Z', 'revision_number': 0, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1530a0fe-3181-4905-89a0-9606e9ca5a5f', 'name': '', 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'mac_address': 'fa:16:3e:20:1e:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'device_owner': 'network:router_interface', 'standard_attr_id': 479, 'fixed_ips': [{'subnet_id': '12999abd-2828-4905-aed0-938c2f27aed8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:06Z', 'updated_at': '2021-11-08T16:17:13Z', 'revision_number': 5, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'subnets': [{'id': '12999abd-2828-4905-aed0-938c2f27aed8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:18:24.440039 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-113eba03-b56f-49ec-867d-1d2486f9d2f5 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.446648 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-113eba03-b56f-49ec-867d-1d2486f9d2f5 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.467381 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-113eba03-b56f-49ec-867d-1d2486f9d2f5 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7b360f27-c3c7-4269-847e-74b632af998a,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:24.471546 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19adf0ab-cf15-4742-bee0-7c56d12560cb req-6210f493-7602-4981-bbf8-af2dee82e805 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:24.473266 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-19adf0ab-cf15-4742-bee0-7c56d12560cb req-6210f493-7602-4981-bbf8-af2dee82e805 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 931 time: 0.1082706 Nov 08 16:18:24.482519 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-113eba03-b56f-49ec-867d-1d2486f9d2f5 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.483786 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-113eba03-b56f-49ec-867d-1d2486f9d2f5 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1656096 Nov 08 16:18:24.486452 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 40706) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:18:24.493704 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-4e53cd68-d544-4339-baaa-11b9550b71ca tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Request body: {'security_group_rule': {'security_group_id': '1d27de4f-b93c-4054-9b9d-62a7c87a8620', 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:18:24.502925 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-70981f13-7356-417c-9cae-1b598f5d6bc3 None None] Provisioning complete for port 794847db-0663-47ab-a2b0-4bdedb698598 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:18:24.503939 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-70981f13-7356-417c-9cae-1b598f5d6bc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.525509 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4e53cd68-d544-4339-baaa-11b9550b71ca tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.550709 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-70981f13-7356-417c-9cae-1b598f5d6bc3 None None] Port 794847db-0663-47ab-a2b0-4bdedb698598 cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:18:24.595975 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4e53cd68-d544-4339-baaa-11b9550b71ca tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.601161 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4e53cd68-d544-4339-baaa-11b9550b71ca tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.620649 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e53cd68-d544-4339-baaa-11b9550b71ca tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e1472716-c301-4e92-acfd-d2f0dfed6a22,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:24.630434 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4e53cd68-d544-4339-baaa-11b9550b71ca tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.632053 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-4e53cd68-d544-4339-baaa-11b9550b71ca tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1445432 Nov 08 16:18:24.634196 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-19adf0ab-cf15-4742-bee0-7c56d12560cb req-dba0047e-a6f1-4220-ae1a-28125d79d031 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1542778 Nov 08 16:18:24.634789 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 40708) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:18:24.641277 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-db4c90b8-fdea-4ce9-a9df-56601a67d708 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Request body: {'security_group_rule': {'security_group_id': '1d27de4f-b93c-4054-9b9d-62a7c87a8620', 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:18:24.667519 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.db.securitygroups_db [None req-db4c90b8-fdea-4ce9-a9df-56601a67d708 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Project 9ad6e5c060034b2ca263bfdcb07fe807 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 08 16:18:24.673591 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-db4c90b8-fdea-4ce9-a9df-56601a67d708 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.696785 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c7eb69a-5848-446d-90a6-76b556f442c4 None None] New status for floating IP 118c0941-b7aa-470c-a5b1-6341e4cd967c: ACTIVE {{(pid=101247) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 16:18:24.741107 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-db4c90b8-fdea-4ce9-a9df-56601a67d708 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.746046 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-db4c90b8-fdea-4ce9-a9df-56601a67d708 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.764319 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db4c90b8-fdea-4ce9-a9df-56601a67d708 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9c8f7bee-4392-4b75-9a97-0a12b3c437c6,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:24.769511 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-f10f27f8-4429-4dcb-9259-60a8f351b00e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 794847db-0663-47ab-a2b0-4bdedb698598 {{(pid=101244) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:18:24.774109 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-db4c90b8-fdea-4ce9-a9df-56601a67d708 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.778180 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-db4c90b8-fdea-4ce9-a9df-56601a67d708 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1424029 Nov 08 16:18:24.779241 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 40710) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:18:24.781968 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-f10f27f8-4429-4dcb-9259-60a8f351b00e service neutron] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.783465 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-d7bb68d6-d708-491b-860a-13b4645bc704 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Request body: {'security_group_rule': {'security_group_id': '1d27de4f-b93c-4054-9b9d-62a7c87a8620', 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:18:24.794629 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.provisioning_blocks [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-f10f27f8-4429-4dcb-9259-60a8f351b00e service neutron] Transition to ACTIVE for port object 794847db-0663-47ab-a2b0-4bdedb698598 will not be triggered until provisioned by entity L2. {{(pid=101244) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 16:18:24.799326 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-f10f27f8-4429-4dcb-9259-60a8f351b00e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.808503 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.db.securitygroups_db [None req-d7bb68d6-d708-491b-860a-13b4645bc704 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Project 9ad6e5c060034b2ca263bfdcb07fe807 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 08 16:18:24.813609 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d7bb68d6-d708-491b-860a-13b4645bc704 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.866813 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f10f27f8-4429-4dcb-9259-60a8f351b00e service neutron] Pushing event updated for resources: {'Port': ['ID=794847db-0663-47ab-a2b0-4bdedb698598,revision_number=2']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:24.897471 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d7bb68d6-d708-491b-860a-13b4645bc704 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.902685 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d7bb68d6-d708-491b-860a-13b4645bc704 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.919623 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7bb68d6-d708-491b-860a-13b4645bc704 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8dedd54f-51a4-4e32-b42a-555849d33e9b,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:24.937443 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d7bb68d6-d708-491b-860a-13b4645bc704 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:24.941625 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-d7bb68d6-d708-491b-860a-13b4645bc704 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1590638 Nov 08 16:18:24.941786 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-f10f27f8-4429-4dcb-9259-60a8f351b00e service neutron] Attempting to bind port 794847db-0663-47ab-a2b0-4bdedb698598 on host hv-cinder-81618 for vnic_type normal with profile {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:18:24.941786 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-f10f27f8-4429-4dcb-9259-60a8f351b00e service neutron] Attempting to bind port 794847db-0663-47ab-a2b0-4bdedb698598 by drivers openvswitch,hyperv on host hv-cinder-81618 at level 0 using segments [{'id': '1383b9f8-d178-4a90-828c-184fa1886253', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43'}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:18:24.941786 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-f10f27f8-4429-4dcb-9259-60a8f351b00e service neutron] Attempting to bind port 794847db-0663-47ab-a2b0-4bdedb698598 on network a15e051b-c130-4140-aaf2-a45ea7af5b43 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:18:24.946851 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-f10f27f8-4429-4dcb-9259-60a8f351b00e service neutron] Port 794847db-0663-47ab-a2b0-4bdedb698598 on network a15e051b-c130-4140-aaf2-a45ea7af5b43 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81618 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 16:18:24.947244 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-f10f27f8-4429-4dcb-9259-60a8f351b00e service neutron] Attempting to bind port 794847db-0663-47ab-a2b0-4bdedb698598 on network a15e051b-c130-4140-aaf2-a45ea7af5b43 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:18:24.954379 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-f10f27f8-4429-4dcb-9259-60a8f351b00e service neutron] Checking agent: {'id': '54bf9779-c14d-412a-90fc-96b4a6589d5a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81618', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'started_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 18, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:18:24.954713 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-f10f27f8-4429-4dcb-9259-60a8f351b00e service neutron] Checking segment: {'id': '1383b9f8-d178-4a90-828c-184fa1886253', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:18:24.955093 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-f10f27f8-4429-4dcb-9259-60a8f351b00e service neutron] Bound using segment: {'id': '1383b9f8-d178-4a90-828c-184fa1886253', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43'} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:18:24.956096 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-f10f27f8-4429-4dcb-9259-60a8f351b00e service neutron] Bound port: 794847db-0663-47ab-a2b0-4bdedb698598, host: hv-cinder-81618, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1383b9f8-d178-4a90-828c-184fa1886253', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43'}}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:18:24.956457 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-f10f27f8-4429-4dcb-9259-60a8f351b00e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:25.057764 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-f10f27f8-4429-4dcb-9259-60a8f351b00e service neutron] For port 794847db-0663-47ab-a2b0-4bdedb698598, host hv-cinder-81618, cleared binding levels {{(pid=101244) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:18:25.061361 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-f10f27f8-4429-4dcb-9259-60a8f351b00e service neutron] For port 794847db-0663-47ab-a2b0-4bdedb698598, host hv-cinder-81618, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=794847db-0663-47ab-a2b0-4bdedb698598,segment=NetworkSegment(1383b9f8-d178-4a90-828c-184fa1886253),segment_id=1383b9f8-d178-4a90-828c-184fa1886253)] {{(pid=101244) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:18:25.066301 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-efb4ed8a-e928-4199-8cb5-5e2ac2d2c6cf req-5dec332e-0751-458f-8af5-e060a884455a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-265532524&fields=id&tenant_id=9ad6e5c060034b2ca263bfdcb07fe807 HTTP/1.1" status: 200 len: 267 time: 0.0742791 Nov 08 16:18:25.067772 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-f10f27f8-4429-4dcb-9259-60a8f351b00e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:25.124377 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-f10f27f8-4429-4dcb-9259-60a8f351b00e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:25.124994 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-f10f27f8-4429-4dcb-9259-60a8f351b00e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:25.126397 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-f10f27f8-4429-4dcb-9259-60a8f351b00e service neutron] 10.222.0.25 "PUT /v2.0/ports/794847db-0663-47ab-a2b0-4bdedb698598 HTTP/1.1" status: 200 len: 1093 time: 0.8801436 Nov 08 16:18:25.161124 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f10f27f8-4429-4dcb-9259-60a8f351b00e service neutron] Pushing event updated for resources: {'Port': ['ID=794847db-0663-47ab-a2b0-4bdedb698598,revision_number=3']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:25.176043 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efb4ed8a-e928-4199-8cb5-5e2ac2d2c6cf req-2d6a0a6d-4b40-473e-b20c-722321ffcf0a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:25.177542 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-efb4ed8a-e928-4199-8cb5-5e2ac2d2c6cf req-2d6a0a6d-4b40-473e-b20c-722321ffcf0a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 945 time: 0.1013498 Nov 08 16:18:25.192471 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-efb4ed8a-e928-4199-8cb5-5e2ac2d2c6cf req-20ce8895-cffc-4e80-a672-7a592a6ec08a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Request body: {'port': {'security_groups': ['1d0afe5a-015d-4e87-a876-479fff7e7b28', '1d27de4f-b93c-4054-9b9d-62a7c87a8620']}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:18:25.274605 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-72143b4c-9317-48ef-a51e-1a8eabf918c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:25.276154 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-72143b4c-9317-48ef-a51e-1a8eabf918c3 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=343d5ca096394f87bea0950aa3811a13&device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 1096 time: 0.0976887 Nov 08 16:18:25.283889 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-efb4ed8a-e928-4199-8cb5-5e2ac2d2c6cf req-20ce8895-cffc-4e80-a672-7a592a6ec08a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:25.330039 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-1f33f7c7-2bdf-4f91-beb1-81e34f2c2d38 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=794847db-0663-47ab-a2b0-4bdedb698598 HTTP/1.1" status: 200 len: 217 time: 0.0439780 Nov 08 16:18:25.417384 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-2cc92449-d7ba-45bb-a092-ae3562c22a28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:25.418761 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-2cc92449-d7ba-45bb-a092-ae3562c22a28 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=6e4d65b1-4f2c-453a-847c-970dff985732 HTTP/1.1" status: 200 len: 851 time: 0.0669148 Nov 08 16:18:25.518996 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-30a93ebf-6955-42fb-b09a-0ab659f9e2f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:25.520494 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-30a93ebf-6955-42fb-b09a-0ab659f9e2f7 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=a15e051b-c130-4140-aaf2-a45ea7af5b43&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0925381 Nov 08 16:18:25.597508 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5ce49cb3-8d64-40a5-9827-64fa1d2f37c2', 'tag': '794847db-0663-47ab-a2b0-4bdedb698598'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:18:25.599728 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5e1ef974-ecdf-4152-8a09-122585b64323" -d '{"events": [{"name": "network-changed", "server_uuid": "5ce49cb3-8d64-40a5-9827-64fa1d2f37c2", "tag": "794847db-0663-47ab-a2b0-4bdedb698598"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:18:25.618276 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-efb4ed8a-e928-4199-8cb5-5e2ac2d2c6cf req-20ce8895-cffc-4e80-a672-7a592a6ec08a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] For port 304e385a-c4e3-48f0-8723-230b5da69dc3, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=304e385a-c4e3-48f0-8723-230b5da69dc3,segment=NetworkSegment(1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3),segment_id=1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:18:25.641323 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:18:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-608a4d44-5ba2-437d-a3e7-4119a589f1af x-openstack-request-id: req-608a4d44-5ba2-437d-a3e7-4119a589f1af {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:18:25.641607 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5ce49cb3-8d64-40a5-9827-64fa1d2f37c2", "tag": "794847db-0663-47ab-a2b0-4bdedb698598", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:18:25.641884 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-608a4d44-5ba2-437d-a3e7-4119a589f1af {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:18:25.642276 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5ce49cb3-8d64-40a5-9827-64fa1d2f37c2', 'tag': '794847db-0663-47ab-a2b0-4bdedb698598', 'status': 'completed', 'code': 200} Nov 08 16:18:25.672222 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-efb4ed8a-e928-4199-8cb5-5e2ac2d2c6cf req-20ce8895-cffc-4e80-a672-7a592a6ec08a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:25.675498 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-99ce567c-2c78-48c2-b96b-045461546b24 service neutron] 10.222.0.25 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1415451 Nov 08 16:18:25.677254 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-efb4ed8a-e928-4199-8cb5-5e2ac2d2c6cf req-20ce8895-cffc-4e80-a672-7a592a6ec08a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:25.691094 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['304e385a-c4e3-48f0-8723-230b5da69dc3'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:18:25.782263 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efb4ed8a-e928-4199-8cb5-5e2ac2d2c6cf req-20ce8895-cffc-4e80-a672-7a592a6ec08a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:25.782898 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-efb4ed8a-e928-4199-8cb5-5e2ac2d2c6cf req-20ce8895-cffc-4e80-a672-7a592a6ec08a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:25.784313 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-efb4ed8a-e928-4199-8cb5-5e2ac2d2c6cf req-20ce8895-cffc-4e80-a672-7a592a6ec08a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "PUT /v2.0/ports/304e385a-c4e3-48f0-8723-230b5da69dc3 HTTP/1.1" status: 200 len: 981 time: 0.5983837 Nov 08 16:18:25.830802 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20ce8895-cffc-4e80-a672-7a592a6ec08a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Pushing event updated for resources: {'Port': ['ID=304e385a-c4e3-48f0-8723-230b5da69dc3,revision_number=6']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:25.867856 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6046d95a-626f-4fb4-9e88-c42ead6f9d0a req-1bbacb65-7cd5-4df3-9f30-dd3b717c8cfe tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:25.869648 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6046d95a-626f-4fb4-9e88-c42ead6f9d0a req-1bbacb65-7cd5-4df3-9f30-dd3b717c8cfe tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 943 time: 0.1410663 Nov 08 16:18:25.891474 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['304e385a-c4e3-48f0-8723-230b5da69dc3'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:18:25.911374 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cefd8d5c-e812-4bd3-9659-5a9a1fa1a05a req-88415795-9bcb-417a-a962-3edc3ae412eb service neutron] 10.222.0.25 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2260513 Nov 08 16:18:25.962364 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6046d95a-626f-4fb4-9e88-c42ead6f9d0a req-4b95ef30-7108-4c92-a041-5e27764def03 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0851457 Nov 08 16:18:25.971647 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-295328e1-ff86-41f9-ab47-da97334bf746 req-7ef2bca0-3f85-4387-9e67-9fbb639991b7 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:25.979667 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-295328e1-ff86-41f9-ab47-da97334bf746 req-7ef2bca0-3f85-4387-9e67-9fbb639991b7 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 984 time: 0.1090012 Nov 08 16:18:26.058426 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e1ef974-ecdf-4152-8a09-122585b64323 req-8098258d-dae8-49ae-9153-91649a073662 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:26.060360 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5e1ef974-ecdf-4152-8a09-122585b64323 req-8098258d-dae8-49ae-9153-91649a073662 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=343d5ca096394f87bea0950aa3811a13&device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 1096 time: 0.0781188 Nov 08 16:18:26.064282 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-dc55934a-28d9-430b-af4a-c827b3f7a695 None None] Provisioning complete for port 304e385a-c4e3-48f0-8723-230b5da69dc3 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:18:26.064645 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-dc55934a-28d9-430b-af4a-c827b3f7a695 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:26.067326 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-295328e1-ff86-41f9-ab47-da97334bf746 req-fcf82c38-4b45-46c5-a9a3-20f76aafe826 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&id=1d27de4f-b93c-4054-9b9d-62a7c87a8620&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0868502 Nov 08 16:18:26.155382 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e1ef974-ecdf-4152-8a09-122585b64323 req-95373198-cda7-4579-897e-a58495cd240c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:26.156875 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5e1ef974-ecdf-4152-8a09-122585b64323 req-95373198-cda7-4579-897e-a58495cd240c service neutron] 10.222.0.25 "GET /v2.0/networks?id=a15e051b-c130-4140-aaf2-a45ea7af5b43 HTTP/1.1" status: 200 len: 913 time: 0.0883281 Nov 08 16:18:26.198365 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5e1ef974-ecdf-4152-8a09-122585b64323 req-0933a8e1-7105-4c80-9794-2b50b63c0a9e service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=794847db-0663-47ab-a2b0-4bdedb698598 HTTP/1.1" status: 200 len: 217 time: 0.0330820 Nov 08 16:18:26.248980 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e1ef974-ecdf-4152-8a09-122585b64323 req-b36618d3-d6cb-4eb9-b7b3-b18cf370e09b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:26.251090 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5e1ef974-ecdf-4152-8a09-122585b64323 req-b36618d3-d6cb-4eb9-b7b3-b18cf370e09b service neutron] 10.222.0.25 "GET /v2.0/subnets?id=6e4d65b1-4f2c-453a-847c-970dff985732 HTTP/1.1" status: 200 len: 851 time: 0.0443046 Nov 08 16:18:26.297027 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e1ef974-ecdf-4152-8a09-122585b64323 req-53e8b193-da97-49a4-8277-0fa0f79be1d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:26.298534 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5e1ef974-ecdf-4152-8a09-122585b64323 req-53e8b193-da97-49a4-8277-0fa0f79be1d2 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=a15e051b-c130-4140-aaf2-a45ea7af5b43&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0390227 Nov 08 16:18:26.390262 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5e1ef974-ecdf-4152-8a09-122585b64323 req-0c3a6058-8223-4a6f-ae21-387566bc7b6b service neutron] 10.222.0.25 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0822847 Nov 08 16:18:26.479023 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5e1ef974-ecdf-4152-8a09-122585b64323 req-26b55406-4de4-424b-88c5-191811031351 service neutron] 10.222.0.25 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0797181 Nov 08 16:18:27.089276 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ed8556f-f997-4ee4-8bea-9ea4658c08e8 req-43d66942-c7d9-4332-96ac-516b45df7754 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:27.090777 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5ed8556f-f997-4ee4-8bea-9ea4658c08e8 req-43d66942-c7d9-4332-96ac-516b45df7754 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 943 time: 0.0514703 Nov 08 16:18:27.139139 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5ed8556f-f997-4ee4-8bea-9ea4658c08e8 req-d172388b-d0ef-4925-a49f-4bfa7a7f0a77 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419431 Nov 08 16:18:27.643651 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912', 'tag': '304e385a-c4e3-48f0-8723-230b5da69dc3'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:18:27.645993 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-577368a8-4428-4190-8fc1-695f65d445d7" -d '{"events": [{"name": "network-changed", "server_uuid": "4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912", "tag": "304e385a-c4e3-48f0-8723-230b5da69dc3"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:18:27.681520 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:18:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3f75dafd-9af0-4111-8960-7800a4655625 x-openstack-request-id: req-3f75dafd-9af0-4111-8960-7800a4655625 {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:18:27.681840 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912", "tag": "304e385a-c4e3-48f0-8723-230b5da69dc3", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:18:27.682094 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-3f75dafd-9af0-4111-8960-7800a4655625 {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:18:27.682489 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912', 'tag': '304e385a-c4e3-48f0-8723-230b5da69dc3', 'status': 'completed', 'code': 200} Nov 08 16:18:27.751167 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-577368a8-4428-4190-8fc1-695f65d445d7 req-2e948de9-cead-4cee-944f-91a12f78e822 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:27.752552 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-577368a8-4428-4190-8fc1-695f65d445d7 req-2e948de9-cead-4cee-944f-91a12f78e822 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=9ad6e5c060034b2ca263bfdcb07fe807&device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 1137 time: 0.0399768 Nov 08 16:18:27.841674 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-577368a8-4428-4190-8fc1-695f65d445d7 req-5857a9a0-7634-42c6-80e6-159443052a33 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:27.843125 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-577368a8-4428-4190-8fc1-695f65d445d7 req-5857a9a0-7634-42c6-80e6-159443052a33 service neutron] 10.222.0.25 "GET /v2.0/networks?id=52eb1d65-dc7c-45c5-9521-97cb18715837 HTTP/1.1" status: 200 len: 915 time: 0.0833638 Nov 08 16:18:27.910389 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-577368a8-4428-4190-8fc1-695f65d445d7 req-01feb961-8f2d-4785-81d6-1b8e685f55d4 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=304e385a-c4e3-48f0-8723-230b5da69dc3 HTTP/1.1" status: 200 len: 1001 time: 0.0566177 Nov 08 16:18:27.958963 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-577368a8-4428-4190-8fc1-695f65d445d7 req-2eeb09d6-1256-4ba8-9688-353d84f06bc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:27.960332 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-577368a8-4428-4190-8fc1-695f65d445d7 req-2eeb09d6-1256-4ba8-9688-353d84f06bc5 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=12999abd-2828-4905-aed0-938c2f27aed8 HTTP/1.1" status: 200 len: 853 time: 0.0417163 Nov 08 16:18:28.012122 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-577368a8-4428-4190-8fc1-695f65d445d7 req-813b37d2-86ff-460d-8007-ca4b391596cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:28.014185 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-577368a8-4428-4190-8fc1-695f65d445d7 req-813b37d2-86ff-460d-8007-ca4b391596cf service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=52eb1d65-dc7c-45c5-9521-97cb18715837&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0420351 Nov 08 16:18:28.104566 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-577368a8-4428-4190-8fc1-695f65d445d7 req-2a4d9b74-d76b-44b6-9b53-faf4bf0943aa service neutron] 10.222.0.25 "GET /v2.0/networks/52eb1d65-dc7c-45c5-9521-97cb18715837?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0770116 Nov 08 16:18:28.197525 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-577368a8-4428-4190-8fc1-695f65d445d7 req-7a4321f0-b91e-458e-a57e-61fd37da1763 service neutron] 10.222.0.25 "GET /v2.0/networks/52eb1d65-dc7c-45c5-9521-97cb18715837?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0850070 Nov 08 16:18:28.252848 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe61589f-0aaf-46df-88dc-1b6836f6180f req-0675fcef-5b0e-438f-9276-adf45defc63a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:28.254340 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fe61589f-0aaf-46df-88dc-1b6836f6180f req-0675fcef-5b0e-438f-9276-adf45defc63a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 943 time: 0.0485990 Nov 08 16:18:28.302145 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fe61589f-0aaf-46df-88dc-1b6836f6180f req-9a0abe07-8627-4e31-ba88-2d92bdf6de15 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418491 Nov 08 16:18:29.414049 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ef852fc-52cb-4c29-87af-16477baa09fc req-0f1d3f0e-6e0f-4158-b9fb-ed1840bf47a5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:29.415477 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6ef852fc-52cb-4c29-87af-16477baa09fc req-0f1d3f0e-6e0f-4158-b9fb-ed1840bf47a5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 943 time: 0.0495296 Nov 08 16:18:29.462395 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6ef852fc-52cb-4c29-87af-16477baa09fc req-057debf6-373e-407d-801a-bc26fe18b973 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406744 Nov 08 16:18:30.487434 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d79a94e-f74e-46e4-bcb6-538adca2f0b3 req-8f134ef9-ec85-4964-bf6d-1597827011cb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:30.489059 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3d79a94e-f74e-46e4-bcb6-538adca2f0b3 req-8f134ef9-ec85-4964-bf6d-1597827011cb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0515454 Nov 08 16:18:30.535965 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3d79a94e-f74e-46e4-bcb6-538adca2f0b3 req-d948c41a-40c0-4278-a834-8838b7ec918d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404963 Nov 08 16:18:30.582521 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7cee80a-4c4b-424d-8430-7d37003f9dc5 req-54a4ccb4-0e92-4260-8057-20910fb74ca5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:30.584110 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c7cee80a-4c4b-424d-8430-7d37003f9dc5 req-54a4ccb4-0e92-4260-8057-20910fb74ca5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 943 time: 0.0471816 Nov 08 16:18:30.631901 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c7cee80a-4c4b-424d-8430-7d37003f9dc5 req-baa0c71a-f0ca-491b-8e77-993a52718c25 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419843 Nov 08 16:18:31.650803 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ddfcae8-9115-4328-88c5-ec5519da34eb req-f3c3b4e8-c24c-4b78-bde1-af1a797d3315 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:31.652290 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4ddfcae8-9115-4328-88c5-ec5519da34eb req-f3c3b4e8-c24c-4b78-bde1-af1a797d3315 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0499477 Nov 08 16:18:31.946713 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4ddfcae8-9115-4328-88c5-ec5519da34eb req-153d6f2d-8621-4390-aac7-891fe2a95b28 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2874734 Nov 08 16:18:31.958633 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-399fd7b2-7c93-4ef7-a7ae-671f164bffb5 req-a14f0095-9a2d-4756-b3eb-45a1ba0d885c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:31.960061 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-399fd7b2-7c93-4ef7-a7ae-671f164bffb5 req-a14f0095-9a2d-4756-b3eb-45a1ba0d885c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 943 time: 0.0667214 Nov 08 16:18:32.008485 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-399fd7b2-7c93-4ef7-a7ae-671f164bffb5 req-32f8917d-cb78-409a-8378-25ed3e7e8c6b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419507 Nov 08 16:18:33.059962 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d09c209-252b-4d0f-bc9a-c982d0c61ce4 req-8c6f400a-e9dc-4f0e-bba3-03ae0139629b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:33.061428 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6d09c209-252b-4d0f-bc9a-c982d0c61ce4 req-8c6f400a-e9dc-4f0e-bba3-03ae0139629b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0480115 Nov 08 16:18:33.134918 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6d09c209-252b-4d0f-bc9a-c982d0c61ce4 req-8b9d01e1-4f89-42e6-af3b-7f5e3f17023c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0676000 Nov 08 16:18:33.149206 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-785b28e5-1715-43a6-834c-d03694096c66 req-eb160445-66e2-4648-a6ba-6ff80c02b33c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:33.150686 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-785b28e5-1715-43a6-834c-d03694096c66 req-eb160445-66e2-4648-a6ba-6ff80c02b33c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 943 time: 0.0683553 Nov 08 16:18:33.198407 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-785b28e5-1715-43a6-834c-d03694096c66 req-ea1a2280-0aba-4f30-88e5-b0803ff718dd tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418108 Nov 08 16:18:34.093213 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 794847db-0663-47ab-a2b0-4bdedb698598 details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:18:34.187439 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 794847db-0663-47ab-a2b0-4bdedb698598, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=794847db-0663-47ab-a2b0-4bdedb698598,segment=NetworkSegment(1383b9f8-d178-4a90-828c-184fa1886253),segment_id=1383b9f8-d178-4a90-828c-184fa1886253)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:18:34.198832 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': '794847db-0663-47ab-a2b0-4bdedb698598', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'port_id': '794847db-0663-47ab-a2b0-4bdedb698598', 'mac_address': 'fa:16:3e:43:4e:af', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 161, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:18:34.239921 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:34.248556 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d11fb67-b22b-4b1b-956f-d9996d11155f req-00d041d1-2c07-4431-9a34-bd8e285fb436 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:34.250223 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4d11fb67-b22b-4b1b-956f-d9996d11155f req-00d041d1-2c07-4431-9a34-bd8e285fb436 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0489414 Nov 08 16:18:34.253113 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 794847db-0663-47ab-a2b0-4bdedb698598 {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:18:34.271883 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 794847db-0663-47ab-a2b0-4bdedb698598, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=794847db-0663-47ab-a2b0-4bdedb698598,segment=NetworkSegment(1383b9f8-d178-4a90-828c-184fa1886253),segment_id=1383b9f8-d178-4a90-828c-184fa1886253)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:18:34.275929 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:34.321513 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=794847db-0663-47ab-a2b0-4bdedb698598,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:34.328314 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4d11fb67-b22b-4b1b-956f-d9996d11155f req-e56c3ada-7160-4558-9a60-d40fbb09c1a8 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0717404 Nov 08 16:18:34.341325 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65cd49ab-f9a7-4293-8d1f-b5c67000a1e3 req-29beabd1-26d0-481e-80a1-2cb68e964dd5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:34.342825 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-65cd49ab-f9a7-4293-8d1f-b5c67000a1e3 req-29beabd1-26d0-481e-80a1-2cb68e964dd5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 944 time: 0.0733681 Nov 08 16:18:34.390905 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-65cd49ab-f9a7-4293-8d1f-b5c67000a1e3 req-923d5c1c-a35b-4e91-b11e-fa2b27937827 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422451 Nov 08 16:18:34.665554 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['794847db-0663-47ab-a2b0-4bdedb698598'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:18:35.440494 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6880858e-50c0-48f9-8e52-fb9930b4c666 req-9e23209a-7ad2-4341-8c10-0d32155373d2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:35.442017 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6880858e-50c0-48f9-8e52-fb9930b4c666 req-9e23209a-7ad2-4341-8c10-0d32155373d2 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0476065 Nov 08 16:18:35.517754 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6880858e-50c0-48f9-8e52-fb9930b4c666 req-41bd69b9-34a6-45d2-9e6e-15218613268e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0699365 Nov 08 16:18:35.532024 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbdb81ad-31f7-496e-896a-1a8082a0c2ef req-f2dec8e5-13cc-4d85-b321-4eb4bc058bb0 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:35.533588 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bbdb81ad-31f7-496e-896a-1a8082a0c2ef req-f2dec8e5-13cc-4d85-b321-4eb4bc058bb0 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 944 time: 0.0724280 Nov 08 16:18:35.582194 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bbdb81ad-31f7-496e-896a-1a8082a0c2ef req-705190b9-cb09-4d6a-a9c8-abfa68f58dff tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428286 Nov 08 16:18:36.112108 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 794847db-0663-47ab-a2b0-4bdedb698598 up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:18:36.162232 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning for port 794847db-0663-47ab-a2b0-4bdedb698598 completed by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 16:18:36.165909 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port 794847db-0663-47ab-a2b0-4bdedb698598 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:18:36.166281 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:36.238870 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:36.260734 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5ce49cb3-8d64-40a5-9827-64fa1d2f37c2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '794847db-0663-47ab-a2b0-4bdedb698598'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:18:36.263514 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2f0bc988-a725-48f3-b90a-de0924523f3e" -d '{"events": [{"server_uuid": "5ce49cb3-8d64-40a5-9827-64fa1d2f37c2", "name": "network-vif-plugged", "status": "completed", "tag": "794847db-0663-47ab-a2b0-4bdedb698598"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:18:36.279192 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 794847db-0663-47ab-a2b0-4bdedb698598, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=794847db-0663-47ab-a2b0-4bdedb698598,segment=NetworkSegment(1383b9f8-d178-4a90-828c-184fa1886253),segment_id=1383b9f8-d178-4a90-828c-184fa1886253)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:18:36.283614 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:36.305924 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:18:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-884ddbe8-5198-46a1-a936-e8608c077259 x-openstack-request-id: req-884ddbe8-5198-46a1-a936-e8608c077259 {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:18:36.306226 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5ce49cb3-8d64-40a5-9827-64fa1d2f37c2", "name": "network-vif-plugged", "status": "completed", "tag": "794847db-0663-47ab-a2b0-4bdedb698598", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:18:36.306478 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-884ddbe8-5198-46a1-a936-e8608c077259 {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:18:36.306861 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5ce49cb3-8d64-40a5-9827-64fa1d2f37c2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '794847db-0663-47ab-a2b0-4bdedb698598', 'code': 200} Nov 08 16:18:36.332920 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=794847db-0663-47ab-a2b0-4bdedb698598,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:36.542600 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6640e9c3-3989-492c-ac7d-2e5b1e17a9e2 req-efa1159d-dd0a-444a-af74-17681a4f4e7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:36.544618 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6640e9c3-3989-492c-ac7d-2e5b1e17a9e2 req-efa1159d-dd0a-444a-af74-17681a4f4e7f service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 1098 time: 0.0382986 Nov 08 16:18:36.599969 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6640e9c3-3989-492c-ac7d-2e5b1e17a9e2 req-1b573f76-bf9e-4344-9d1e-e7e8bc940905 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0475833 Nov 08 16:18:36.634969 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b7aa30a-3c98-487c-a0c7-a5d9d3f552a2 req-7067e6a8-6c91-448b-87d5-f1decdd473dd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:36.636793 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2b7aa30a-3c98-487c-a0c7-a5d9d3f552a2 req-7067e6a8-6c91-448b-87d5-f1decdd473dd tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0491560 Nov 08 16:18:36.728478 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2b7aa30a-3c98-487c-a0c7-a5d9d3f552a2 req-a8f7db68-1a68-4ac8-89fb-a93d70656a55 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0853434 Nov 08 16:18:36.738690 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e10a0856-adeb-48fe-975c-0eadc31c40ad req-4d3e2d69-c2df-4e59-93d0-ac221ed83877 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:36.740378 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e10a0856-adeb-48fe-975c-0eadc31c40ad req-4d3e2d69-c2df-4e59-93d0-ac221ed83877 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 945 time: 0.0893974 Nov 08 16:18:36.788543 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e10a0856-adeb-48fe-975c-0eadc31c40ad req-f3ac5346-71ec-4523-9f5b-0ed5268198b5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423403 Nov 08 16:18:37.839526 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54c01f14-6d8c-49c8-8001-39c8b25f2d49 req-f80ac169-b7e7-4ac4-bb8b-b3c23f769591 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:37.841520 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-54c01f14-6d8c-49c8-8001-39c8b25f2d49 req-f80ac169-b7e7-4ac4-bb8b-b3c23f769591 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0484929 Nov 08 16:18:37.921517 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-54c01f14-6d8c-49c8-8001-39c8b25f2d49 req-3958153a-2560-4cf3-b4cb-8430d090c8c5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0741315 Nov 08 16:18:37.929943 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0db976ac-1925-4c4d-844f-b3d1c7b91686 req-068f1070-2054-4fba-a586-5249774cee0a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:37.931401 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0db976ac-1925-4c4d-844f-b3d1c7b91686 req-068f1070-2054-4fba-a586-5249774cee0a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 945 time: 0.0772722 Nov 08 16:18:37.980073 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0db976ac-1925-4c4d-844f-b3d1c7b91686 req-9cf7a46a-a9dd-499f-822e-a20ae25640a9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426598 Nov 08 16:18:38.119011 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-35aa0ac0-5af5-41da-9c65-c5a77e1349ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:39.037972 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ec546dc-4393-40de-ba58-b369fe665a92 req-7ef0bf03-da33-47a7-aa41-126dabb212ad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:39.039480 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9ec546dc-4393-40de-ba58-b369fe665a92 req-7ef0bf03-da33-47a7-aa41-126dabb212ad tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0489306 Nov 08 16:18:39.119921 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9ec546dc-4393-40de-ba58-b369fe665a92 req-1cf1e0ee-6e18-49e4-8584-9a9b650c6d02 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0739295 Nov 08 16:18:39.128748 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea26e76d-a30d-4ea0-be64-b79f81801c16 req-0e46ed1d-24e5-48b2-aa4c-09fd55fbd606 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:39.130204 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ea26e76d-a30d-4ea0-be64-b79f81801c16 req-0e46ed1d-24e5-48b2-aa4c-09fd55fbd606 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 945 time: 0.0783496 Nov 08 16:18:39.177555 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ea26e76d-a30d-4ea0-be64-b79f81801c16 req-5ac64989-4746-4465-b6de-63afd2f1b2eb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412936 Nov 08 16:18:39.287454 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27291c19-a222-4a12-9e4b-14151592f157 req-626729c3-c179-46b8-b0a3-6a1ffd67d687 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:39.288948 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-27291c19-a222-4a12-9e4b-14151592f157 req-626729c3-c179-46b8-b0a3-6a1ffd67d687 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 945 time: 0.0478613 Nov 08 16:18:39.338240 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-27291c19-a222-4a12-9e4b-14151592f157 req-550111f9-14c9-41a8-bd38-068dcf448079 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428071 Nov 08 16:18:39.360355 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 40788) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:18:39.397395 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9513055d-8c16-460f-8627-87e78847f358 tempest-TestVolumeBootPattern-411305480 tempest-TestVolumeBootPattern-411305480-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:39.398911 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-9513055d-8c16-460f-8627-87e78847f358 tempest-TestVolumeBootPattern-411305480 tempest-TestVolumeBootPattern-411305480-project-admin] 10.222.0.37 "GET /v2.0/ports?device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 1093 time: 0.0375688 Nov 08 16:18:39.401549 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 40790) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:18:39.406313 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Request body: {'floatingip': {'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'port_id': '794847db-0663-47ab-a2b0-4bdedb698598', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'fixed_ip_address': '172.20.0.9'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:18:39.427530 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for floatingip, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:39.522598 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:39.629059 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Allocated IP 172.27.3.223 (68f46265-b42a-49a0-8d57-f9362045cd9b/4728e4be-5a19-43c0-89cf-ced2a190645d/1f77e135-23e3-4d19-a577-01f3b4e8bc2a) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:18:39.726810 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:39.766647 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:39.802165 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Network 68f46265-b42a-49a0-8d57-f9362045cd9b is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:18:39.806805 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:18:39.810930 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:18:39.816636 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Pushing event updated for resources: {'Port': ['ID=1f77e135-23e3-4d19-a577-01f3b4e8bc2a,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:39.845919 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:18:39.846261 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:18:39.846593 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:18:39.846919 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:18:39.847243 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:18:39.847565 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:18:39.847883 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:18:39.848201 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:18:39.848520 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:18:39.848834 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:18:39.849145 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:18:39.849456 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:18:40.166016 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:40.269345 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e4f36b3-69ff-499b-b55a-850d2a045b51 req-eaa26a51-8930-4906-a47c-abd22963ea1f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:40.270856 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7e4f36b3-69ff-499b-b55a-850d2a045b51 req-eaa26a51-8930-4906-a47c-abd22963ea1f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0844038 Nov 08 16:18:40.271822 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:40.383744 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7e4f36b3-69ff-499b-b55a-850d2a045b51 req-06e10172-fd3e-46f6-b6d7-722c69a314a1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0930595 Nov 08 16:18:40.450202 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:40.454712 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:40.517636 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Pushing event updated for resources: {'Port': ['ID=1f77e135-23e3-4d19-a577-01f3b4e8bc2a,revision_number=2']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:18:40.531074 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-2032271'] for floatingip, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:40.587384 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-597760c7-ebd7-4928-aa60-cc8a459ef92c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:40.629284 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.db.l3_db [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Floating IP f569e85e-1fe4-4f0e-9589-b8abeab39e2b associated. External IP: 172.27.3.223, port: 794847db-0663-47ab-a2b0-4bdedb698598. Nov 08 16:18:40.824362 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Router f80d01f3-bee2-4682-8f4a-92536ad96209 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:18:40.927560 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:18:40.936712 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7620f162-f695-46e3-81df-22124c506ddb None None] Sync routers for ids ['f80d01f3-bee2-4682-8f4a-92536ad96209'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:18:40.944549 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for floatingip, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:40.948668 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7620f162-f695-46e3-81df-22124c506ddb None None] Routers {'f80d01f3-bee2-4682-8f4a-92536ad96209'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:18:40.949273 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-7620f162-f695-46e3-81df-22124c506ddb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:18:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['f80d01f3-bee2-4682-8f4a-92536ad96209'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:18:40.975040 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-ac21e6ea-a409-4826-aa62-090f1df795bb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.5724666 Nov 08 16:18:40.975620 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5ce49cb3-8d64-40a5-9827-64fa1d2f37c2', 'tag': '794847db-0663-47ab-a2b0-4bdedb698598'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:18:40.977868 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3f0eab59-2f41-4585-8191-6ba84edec0db" -d '{"events": [{"name": "network-changed", "server_uuid": "5ce49cb3-8d64-40a5-9827-64fa1d2f37c2", "tag": "794847db-0663-47ab-a2b0-4bdedb698598"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:18:41.015264 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:18:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9499499f-828c-49fd-bc3d-9bc318797ac0 x-openstack-request-id: req-9499499f-828c-49fd-bc3d-9bc318797ac0 {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:18:41.015561 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5ce49cb3-8d64-40a5-9827-64fa1d2f37c2", "tag": "794847db-0663-47ab-a2b0-4bdedb698598", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:18:41.015817 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-9499499f-828c-49fd-bc3d-9bc318797ac0 {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:18:41.016225 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5ce49cb3-8d64-40a5-9827-64fa1d2f37c2', 'tag': '794847db-0663-47ab-a2b0-4bdedb698598', 'status': 'completed', 'code': 200} Nov 08 16:18:41.060130 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-7620f162-f695-46e3-81df-22124c506ddb None None] Set router f80d01f3-bee2-4682-8f4a-92536ad96209 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:18:41.092084 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f0eab59-2f41-4585-8191-6ba84edec0db req-eadf67ec-d8c4-440d-bf97-db6e2b3bbd0b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:41.093591 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3f0eab59-2f41-4585-8191-6ba84edec0db req-eadf67ec-d8c4-440d-bf97-db6e2b3bbd0b service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=343d5ca096394f87bea0950aa3811a13&device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 1098 time: 0.0399358 Nov 08 16:18:41.185538 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f0eab59-2f41-4585-8191-6ba84edec0db req-e8f36b23-9b19-4e01-a810-afea2eba87b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:41.187179 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3f0eab59-2f41-4585-8191-6ba84edec0db req-e8f36b23-9b19-4e01-a810-afea2eba87b4 service neutron] 10.222.0.25 "GET /v2.0/networks?id=a15e051b-c130-4140-aaf2-a45ea7af5b43 HTTP/1.1" status: 200 len: 913 time: 0.0865302 Nov 08 16:18:41.251366 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3f0eab59-2f41-4585-8191-6ba84edec0db req-153bb18b-039b-41d5-9146-afc049225656 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=794847db-0663-47ab-a2b0-4bdedb698598 HTTP/1.1" status: 200 len: 999 time: 0.0564990 Nov 08 16:18:41.278610 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-7620f162-f695-46e3-81df-22124c506ddb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 4, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': 'f569e85e-1fe4-4f0e-9589-b8abeab39e2b', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'floating_ip_address': '172.27.3.223', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'port_id': '794847db-0663-47ab-a2b0-4bdedb698598', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 536, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'mac_address': 'fa:16:3e:43:4e:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ce49cb3-8d64-40a5-9827-64fa1d2f37c2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:18:40Z', 'updated_at': '2021-11-08T16:18:40Z', 'revision_number': 0, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbdf39d9-310f-42ea-a1f1-4e1b15048b73', 'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'mac_address': 'fa:16:3e:13:ec:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_interface', 'standard_attr_id': 228, 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:28Z', 'updated_at': '2021-11-08T16:12:32Z', 'revision_number': 5, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'subnets': [{'id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:18:41.303715 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7620f162-f695-46e3-81df-22124c506ddb None None] Checking router: f80d01f3-bee2-4682-8f4a-92536ad96209 for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:18:41.305885 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f0eab59-2f41-4585-8191-6ba84edec0db req-895123f1-2631-4f42-b259-179f54750be4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:41.308123 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3f0eab59-2f41-4585-8191-6ba84edec0db req-895123f1-2631-4f42-b259-179f54750be4 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=6e4d65b1-4f2c-453a-847c-970dff985732 HTTP/1.1" status: 200 len: 851 time: 0.0490408 Nov 08 16:18:41.311885 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7620f162-f695-46e3-81df-22124c506ddb None None] Routers {'f80d01f3-bee2-4682-8f4a-92536ad96209'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:18:41.312475 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-7620f162-f695-46e3-81df-22124c506ddb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:18:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['f80d01f3-bee2-4682-8f4a-92536ad96209'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:18:41.357882 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f0eab59-2f41-4585-8191-6ba84edec0db req-76a828c3-87fa-4174-b1fc-1c21fa96ca48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:41.359296 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3f0eab59-2f41-4585-8191-6ba84edec0db req-76a828c3-87fa-4174-b1fc-1c21fa96ca48 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=a15e051b-c130-4140-aaf2-a45ea7af5b43&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0404210 Nov 08 16:18:41.414659 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-7620f162-f695-46e3-81df-22124c506ddb None None] Set router f80d01f3-bee2-4682-8f4a-92536ad96209 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:18:41.450052 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3f0eab59-2f41-4585-8191-6ba84edec0db req-4bd98201-1ea0-440b-b9a5-3ef9cce49032 service neutron] 10.222.0.25 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0822649 Nov 08 16:18:41.562781 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:41.563634 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b63a27d7-83de-4021-994a-e5924586c1dc req-829bcc63-97a4-43ec-9138-1ce17e68a96c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:41.565120 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b63a27d7-83de-4021-994a-e5924586c1dc req-829bcc63-97a4-43ec-9138-1ce17e68a96c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.1005914 Nov 08 16:18:41.592445 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3f0eab59-2f41-4585-8191-6ba84edec0db req-f2510971-fe67-4a76-9520-99a9c4ac305d service neutron] 10.222.0.25 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1349778 Nov 08 16:18:41.625557 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b63a27d7-83de-4021-994a-e5924586c1dc req-9b20e62c-ad97-4f20-8dad-d85dbd14c265 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0492973 Nov 08 16:18:41.649410 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-7620f162-f695-46e3-81df-22124c506ddb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 4, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': 'f569e85e-1fe4-4f0e-9589-b8abeab39e2b', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'floating_ip_address': '172.27.3.223', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'port_id': '794847db-0663-47ab-a2b0-4bdedb698598', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 536, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'mac_address': 'fa:16:3e:43:4e:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ce49cb3-8d64-40a5-9827-64fa1d2f37c2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:18:40Z', 'updated_at': '2021-11-08T16:18:40Z', 'revision_number': 0, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbdf39d9-310f-42ea-a1f1-4e1b15048b73', 'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'mac_address': 'fa:16:3e:13:ec:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_interface', 'standard_attr_id': 228, 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:28Z', 'updated_at': '2021-11-08T16:12:32Z', 'revision_number': 5, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'subnets': [{'id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:18:41.675003 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7620f162-f695-46e3-81df-22124c506ddb None None] The sync data for ids ['f80d01f3-bee2-4682-8f4a-92536ad96209'] in dv-cinder-816187-2-iscsi is: [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 4, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': 'f569e85e-1fe4-4f0e-9589-b8abeab39e2b', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'floating_ip_address': '172.27.3.223', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'port_id': '794847db-0663-47ab-a2b0-4bdedb698598', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 536, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'mac_address': 'fa:16:3e:43:4e:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ce49cb3-8d64-40a5-9827-64fa1d2f37c2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:18:40Z', 'updated_at': '2021-11-08T16:18:40Z', 'revision_number': 0, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbdf39d9-310f-42ea-a1f1-4e1b15048b73', 'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'mac_address': 'fa:16:3e:13:ec:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_interface', 'standard_attr_id': 228, 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:28Z', 'updated_at': '2021-11-08T16:12:32Z', 'revision_number': 5, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'subnets': [{'id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:18:41.853173 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-444993ab-1278-44ba-ac83-7473720fdcbc None None] New status for floating IP f569e85e-1fe4-4f0e-9589-b8abeab39e2b: ACTIVE {{(pid=101247) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 16:18:42.601281 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:18:42.743851 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e1287ac-b94e-4a6b-b12c-124defd26ad6 req-51a968e0-4521-4f6c-8c2f-6f7670be244e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:42.745570 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2e1287ac-b94e-4a6b-b12c-124defd26ad6 req-51a968e0-4521-4f6c-8c2f-6f7670be244e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0518534 Nov 08 16:18:42.790919 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2e1287ac-b94e-4a6b-b12c-124defd26ad6 req-97604a3c-1d6d-4ebe-a422-d05564ddb02b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0395410 Nov 08 16:18:43.271714 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:43.902150 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f59c26fd-94b4-48ec-96d5-1800f2b3ae51 req-ccc17df8-c6cc-4e01-8f16-65c9b2a7b8d5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:43.904107 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f59c26fd-94b4-48ec-96d5-1800f2b3ae51 req-ccc17df8-c6cc-4e01-8f16-65c9b2a7b8d5 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0472240 Nov 08 16:18:43.949940 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f59c26fd-94b4-48ec-96d5-1800f2b3ae51 req-db9f4df6-f968-4c7e-ae03-5cad91fbc1be tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400214 Nov 08 16:18:43.959559 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:18:45.068235 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb4bcf7d-a116-4853-bea5-d8e7aa37f030 req-07551246-947f-43f1-91ba-ed3bea26a815 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:45.069723 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cb4bcf7d-a116-4853-bea5-d8e7aa37f030 req-07551246-947f-43f1-91ba-ed3bea26a815 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0476272 Nov 08 16:18:45.120197 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cb4bcf7d-a116-4853-bea5-d8e7aa37f030 req-e29b4046-8dd9-4def-8a7b-95c53c90fcd0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439889 Nov 08 16:18:46.232605 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abc645dc-5ec7-4726-933a-77d8996cf248 req-976833e3-0f4d-4b2f-937f-c7be05c62e81 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:46.234054 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-abc645dc-5ec7-4726-933a-77d8996cf248 req-976833e3-0f4d-4b2f-937f-c7be05c62e81 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0467649 Nov 08 16:18:46.282728 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-abc645dc-5ec7-4726-933a-77d8996cf248 req-e148c066-6d78-4363-ae9c-c34687438e05 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425284 Nov 08 16:18:46.475848 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-025cd2fb-3681-41bf-8478-9815c139b3a7 req-c94189ef-ce8c-4608-a06b-530051c4a27f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:46.477366 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-025cd2fb-3681-41bf-8478-9815c139b3a7 req-c94189ef-ce8c-4608-a06b-530051c4a27f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0531218 Nov 08 16:18:46.555217 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-025cd2fb-3681-41bf-8478-9815c139b3a7 req-a4db5a07-4e32-49f7-8c1a-dd1e117ffe9a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0712669 Nov 08 16:18:46.558007 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c5218ff-5407-49a9-9e83-80b9596195cd req-61d3ec83-a631-43cd-ac4d-c63efb6e0269 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:46.559285 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3c5218ff-5407-49a9-9e83-80b9596195cd req-61d3ec83-a631-43cd-ac4d-c63efb6e0269 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=f6e779f0506643d08d984c2971d5a71c&device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 1098 time: 0.0685341 Nov 08 16:18:46.647693 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c5218ff-5407-49a9-9e83-80b9596195cd req-b1d1b75b-39d1-4677-8930-5693780d5120 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:46.649020 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3c5218ff-5407-49a9-9e83-80b9596195cd req-b1d1b75b-39d1-4677-8930-5693780d5120 service neutron] 10.222.0.25 "GET /v2.0/networks?id=75fa9c3e-7bfe-490a-9118-221394c29646 HTTP/1.1" status: 200 len: 911 time: 0.0813003 Nov 08 16:18:46.716081 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3c5218ff-5407-49a9-9e83-80b9596195cd req-4c1a53fb-9a0c-4b88-9ce6-18329aba1933 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f4784d76-6af7-4b31-a9f3-ee25c9087b51 HTTP/1.1" status: 200 len: 1000 time: 0.0586808 Nov 08 16:18:46.763674 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c5218ff-5407-49a9-9e83-80b9596195cd req-7d29ba8e-67e6-4791-83a1-ea53900952a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:46.765029 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3c5218ff-5407-49a9-9e83-80b9596195cd req-7d29ba8e-67e6-4791-83a1-ea53900952a3 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=8b248e51-4c70-4980-9452-c6b625bf96dd HTTP/1.1" status: 200 len: 849 time: 0.0413961 Nov 08 16:18:46.808292 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c5218ff-5407-49a9-9e83-80b9596195cd req-0b67fe49-3ced-49fd-9912-0604225f5081 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:46.809792 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3c5218ff-5407-49a9-9e83-80b9596195cd req-0b67fe49-3ced-49fd-9912-0604225f5081 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=75fa9c3e-7bfe-490a-9118-221394c29646&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0377297 Nov 08 16:18:46.898660 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3c5218ff-5407-49a9-9e83-80b9596195cd req-ce6428dd-3d9e-4982-bd87-a69cba039d7e service neutron] 10.222.0.25 "GET /v2.0/networks/75fa9c3e-7bfe-490a-9118-221394c29646?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0812407 Nov 08 16:18:46.987189 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3c5218ff-5407-49a9-9e83-80b9596195cd req-9451df55-a88c-4347-ade6-3d0620a5fc92 service neutron] 10.222.0.25 "GET /v2.0/networks/75fa9c3e-7bfe-490a-9118-221394c29646?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0801563 Nov 08 16:18:47.676687 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbd6559d-b469-4936-943d-a22be743a42c req-0032ee9a-57a7-4c70-869a-7c590c331bbc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:18:47.678211 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dbd6559d-b469-4936-943d-a22be743a42c req-0032ee9a-57a7-4c70-869a-7c590c331bbc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0506837 Nov 08 16:18:47.727530 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dbd6559d-b469-4936-943d-a22be743a42c req-305865df-bbe4-4bc6-ad50-b9769230342f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426865 Nov 08 16:18:47.951663 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:08.122402 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ce343c90-e933-4c43-bedc-43e6c0694f3c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:10.588221 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-0ee405b3-9043-4dad-8dea-79aa5d089b15 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:11.542676 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:13.273839 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:13.960931 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:17.959787 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:19.600222 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:19:22.336273 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adf4fa93-ac6b-4f45-bc90-f7fac96416aa req-48a9bb8f-20d6-4f66-88c0-784272adb310 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:22.337629 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-adf4fa93-ac6b-4f45-bc90-f7fac96416aa req-48a9bb8f-20d6-4f66-88c0-784272adb310 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 946 time: 0.0474796 Nov 08 16:19:22.383130 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-adf4fa93-ac6b-4f45-bc90-f7fac96416aa req-c78ba3db-5d05-4aa9-8558-f91dcacda7cf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397182 Nov 08 16:19:23.499381 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6a520a1-868a-45bd-97c8-3ea17e22bc29 req-3d0441b1-7e6e-4119-a8d5-c3e9bfc287aa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:23.500814 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b6a520a1-868a-45bd-97c8-3ea17e22bc29 req-3d0441b1-7e6e-4119-a8d5-c3e9bfc287aa tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 946 time: 0.0472066 Nov 08 16:19:23.545565 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b6a520a1-868a-45bd-97c8-3ea17e22bc29 req-1a34f661-674a-46fa-aef5-0298ae87fb0c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389533 Nov 08 16:19:24.315196 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7373d68-7da9-4115-8ed6-f47ed45f9948 req-46aa0392-6538-4d96-8327-f9ea071a4348 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:24.316685 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c7373d68-7da9-4115-8ed6-f47ed45f9948 req-46aa0392-6538-4d96-8327-f9ea071a4348 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.25 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 946 time: 0.0529568 Nov 08 16:19:24.405809 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-c7373d68-7da9-4115-8ed6-f47ed45f9948 req-fc73f672-ef3c-4877-921f-4c3e05a18ae5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Deleting port fbefda08-fc7a-42a0-b714-6dea3d8a5161 {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:19:24.406042 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-c7373d68-7da9-4115-8ed6-f47ed45f9948 req-fc73f672-ef3c-4877-921f-4c3e05a18ae5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:24.747417 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-c7373d68-7da9-4115-8ed6-f47ed45f9948 req-fc73f672-ef3c-4877-921f-4c3e05a18ae5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] For port fbefda08-fc7a-42a0-b714-6dea3d8a5161, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=fbefda08-fc7a-42a0-b714-6dea3d8a5161,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:19:24.748127 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-c7373d68-7da9-4115-8ed6-f47ed45f9948 req-fc73f672-ef3c-4877-921f-4c3e05a18ae5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:24.762605 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd712ad7-43b9-464a-9adf-be411bfef768 req-47e07868-7333-4f33-b929-7dbba95287e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:24.764096 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cd712ad7-43b9-464a-9adf-be411bfef768 req-47e07868-7333-4f33-b929-7dbba95287e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=1c1c8c8d-5f78-45fb-803d-8f7a84df3433 HTTP/1.1" status: 200 len: 946 time: 0.0825310 Nov 08 16:19:24.886219 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cd712ad7-43b9-464a-9adf-be411bfef768 req-91bbb879-f1f9-48df-9423-54507bbe8487 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=25b22689-a549-4355-8242-c53382d480a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1150503 Nov 08 16:19:24.957626 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-c7373d68-7da9-4115-8ed6-f47ed45f9948 req-fc73f672-ef3c-4877-921f-4c3e05a18ae5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:24.958009 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-c7373d68-7da9-4115-8ed6-f47ed45f9948 req-fc73f672-ef3c-4877-921f-4c3e05a18ae5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-2032271'] for floatingip, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:24.958313 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.db.l3_db [req-c7373d68-7da9-4115-8ed6-f47ed45f9948 req-fc73f672-ef3c-4877-921f-4c3e05a18ae5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Floating IP d4af2e67-2c52-4ceb-8852-69c61f0e2870 disassociated. External IP: 172.27.3.146, port: fbefda08-fc7a-42a0-b714-6dea3d8a5161. Nov 08 16:19:24.958642 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-c7373d68-7da9-4115-8ed6-f47ed45f9948 req-fc73f672-ef3c-4877-921f-4c3e05a18ae5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling delete_port for fbefda08-fc7a-42a0-b714-6dea3d8a5161 owned by compute:nova {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:19:25.082173 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-c7373d68-7da9-4115-8ed6-f47ed45f9948 req-fc73f672-ef3c-4877-921f-4c3e05a18ae5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:25.111393 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc73f672-ef3c-4877-921f-4c3e05a18ae5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Pushing event deleted for resources: {'Port': ['ID=fbefda08-fc7a-42a0-b714-6dea3d8a5161,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:19:25.220742 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.l3_agent_scheduler [req-c7373d68-7da9-4115-8ed6-f47ed45f9948 req-fc73f672-ef3c-4877-921f-4c3e05a18ae5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Router e5087790-dc76-4f18-81a3-548feaf21791 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:19:25.323627 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-c7373d68-7da9-4115-8ed6-f47ed45f9948 req-fc73f672-ef3c-4877-921f-4c3e05a18ae5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:19:25.333276 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9ff757c-6197-4b43-8752-b98ae81144a7 None None] Sync routers for ids ['e5087790-dc76-4f18-81a3-548feaf21791'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:19:25.343360 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9ff757c-6197-4b43-8752-b98ae81144a7 None None] Routers {'e5087790-dc76-4f18-81a3-548feaf21791'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:19:25.343958 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-b9ff757c-6197-4b43-8752-b98ae81144a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:19:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['e5087790-dc76-4f18-81a3-548feaf21791'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:19:25.365178 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-c7373d68-7da9-4115-8ed6-f47ed45f9948 req-fc73f672-ef3c-4877-921f-4c3e05a18ae5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] No DVR routers for this DVR port fbefda08-fc7a-42a0-b714-6dea3d8a5161 on host hv-cinder-81618 {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:19:25.367720 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-c7373d68-7da9-4115-8ed6-f47ed45f9948 req-fc73f672-ef3c-4877-921f-4c3e05a18ae5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:25.371307 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c7373d68-7da9-4115-8ed6-f47ed45f9948 req-fc73f672-ef3c-4877-921f-4c3e05a18ae5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.25 "DELETE /v2.0/ports/fbefda08-fc7a-42a0-b714-6dea3d8a5161 HTTP/1.1" status: 204 len: 173 time: 1.0475583 Nov 08 16:19:25.371741 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c1c8c8d-5f78-45fb-803d-8f7a84df3433', 'name': 'network-vif-deleted', 'tag': 'fbefda08-fc7a-42a0-b714-6dea3d8a5161'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:19:25.374032 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5e81ff8a-84a3-4fb2-a283-8bc0b28f556c" -d '{"events": [{"server_uuid": "1c1c8c8d-5f78-45fb-803d-8f7a84df3433", "name": "network-vif-deleted", "tag": "fbefda08-fc7a-42a0-b714-6dea3d8a5161"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:19:25.418517 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:19:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dd7ee787-f215-41c9-b3cd-79f1365c5fed x-openstack-request-id: req-dd7ee787-f215-41c9-b3cd-79f1365c5fed {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:19:25.418806 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1c1c8c8d-5f78-45fb-803d-8f7a84df3433", "name": "network-vif-deleted", "tag": "fbefda08-fc7a-42a0-b714-6dea3d8a5161", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:19:25.419048 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-dd7ee787-f215-41c9-b3cd-79f1365c5fed {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:19:25.419441 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c1c8c8d-5f78-45fb-803d-8f7a84df3433', 'name': 'network-vif-deleted', 'tag': 'fbefda08-fc7a-42a0-b714-6dea3d8a5161', 'status': 'completed', 'code': 200} Nov 08 16:19:25.454773 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-b9ff757c-6197-4b43-8752-b98ae81144a7 None None] Set router e5087790-dc76-4f18-81a3-548feaf21791 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:19:25.663871 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-b9ff757c-6197-4b43-8752-b98ae81144a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'name': 'tempest-AttachVolumeShelveTestJSON-1204269590-router', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118'}], 'enable_snat': True}, 'gw_port_id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:01Z', 'updated_at': '2021-11-08T16:11:11Z', 'revision_number': 4, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'gw_port': {'id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:db:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '9e08c20e-219c-4cd8-b6fe-30829b440d06', 'name': '', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'mac_address': 'fa:16:3e:e6:20:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:09Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 5, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'subnets': [{'id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:19:25.690712 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9ff757c-6197-4b43-8752-b98ae81144a7 None None] Checking router: e5087790-dc76-4f18-81a3-548feaf21791 for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:19:25.698761 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9ff757c-6197-4b43-8752-b98ae81144a7 None None] Routers {'e5087790-dc76-4f18-81a3-548feaf21791'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:19:25.699358 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-b9ff757c-6197-4b43-8752-b98ae81144a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:19:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['e5087790-dc76-4f18-81a3-548feaf21791'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:19:25.806502 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-b9ff757c-6197-4b43-8752-b98ae81144a7 None None] Set router e5087790-dc76-4f18-81a3-548feaf21791 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:19:25.980904 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 40886) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:19:26.041804 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-2d04709f-0cf4-46b2-b757-58db97aa3ed4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:26.064480 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-2d04709f-0cf4-46b2-b757-58db97aa3ed4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:26.115562 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-2d04709f-0cf4-46b2-b757-58db97aa3ed4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:26.118235 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-2d04709f-0cf4-46b2-b757-58db97aa3ed4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:26.120215 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-2d04709f-0cf4-46b2-b757-58db97aa3ed4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "DELETE /v2.0/security-groups/25b22689-a549-4355-8242-c53382d480a6 HTTP/1.1" status: 204 len: 168 time: 0.1381934 Nov 08 16:19:26.122959 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 40888) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:19:26.129203 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d04709f-0cf4-46b2-b757-58db97aa3ed4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=25b22689-a549-4355-8242-c53382d480a6,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:19:26.138191 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-b9ff757c-6197-4b43-8752-b98ae81144a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'name': 'tempest-AttachVolumeShelveTestJSON-1204269590-router', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118'}], 'enable_snat': True}, 'gw_port_id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:01Z', 'updated_at': '2021-11-08T16:11:11Z', 'revision_number': 4, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'gw_port': {'id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:db:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '9e08c20e-219c-4cd8-b6fe-30829b440d06', 'name': '', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'mac_address': 'fa:16:3e:e6:20:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:09Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 5, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'subnets': [{'id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:19:26.144535 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.api.v2.resource [None req-b9fad4aa-3b02-4602-9619-1575fc1af857 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] show failed (client error): The resource could not be found. Nov 08 16:19:26.148139 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-b9fad4aa-3b02-4602-9619-1575fc1af857 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups/25b22689-a549-4355-8242-c53382d480a6 HTTP/1.1" status: 404 len: 347 time: 0.0216148 Nov 08 16:19:26.148762 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 40892) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:19:26.170325 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9ff757c-6197-4b43-8752-b98ae81144a7 None None] The sync data for ids ['e5087790-dc76-4f18-81a3-548feaf21791'] in dv-cinder-816187-2-iscsi is: [{'id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'name': 'tempest-AttachVolumeShelveTestJSON-1204269590-router', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118'}], 'enable_snat': True}, 'gw_port_id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:01Z', 'updated_at': '2021-11-08T16:11:11Z', 'revision_number': 4, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'gw_port': {'id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:db:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '9e08c20e-219c-4cd8-b6fe-30829b440d06', 'name': '', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'mac_address': 'fa:16:3e:e6:20:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:09Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 5, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'subnets': [{'id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:19:26.257333 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device fbefda08-fc7a-42a0-b714-6dea3d8a5161 no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:19:26.273874 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-9ceb92e8-f6e7-4a50-ad24-4d046294ddb7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Deleting port 3d6fe3bf-2ff3-45bc-bd54-49d907904801 {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:19:26.274219 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9ceb92e8-f6e7-4a50-ad24-4d046294ddb7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:26.277911 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] No Port match for: fbefda08-fc7a-42a0-b714-6dea3d8a5161 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:19:26.278248 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device fbefda08-fc7a-42a0-b714-6dea3d8a5161 not bound to the agent host hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:19:26.355153 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9ceb92e8-f6e7-4a50-ad24-4d046294ddb7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:26.355495 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9ceb92e8-f6e7-4a50-ad24-4d046294ddb7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:26.367269 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-9ceb92e8-f6e7-4a50-ad24-4d046294ddb7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling delete_port for 3d6fe3bf-2ff3-45bc-bd54-49d907904801 owned by network:floatingip {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:19:26.392387 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ce13f3c-933d-4f16-809d-e44b8b38b2ba None None] New status for floating IP d4af2e67-2c52-4ceb-8852-69c61f0e2870: DOWN {{(pid=101247) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 16:19:26.507552 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9ceb92e8-f6e7-4a50-ad24-4d046294ddb7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:26.508663 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.db.api [None req-4ce13f3c-933d-4f16-809d-e44b8b38b2ba None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=101247) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 08 16:19:26.509077 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG oslo_db.api [None req-4ce13f3c-933d-4f16-809d-e44b8b38b2ba None None] Performing DB retry for function neutron.api.rpc.handlers.l3_rpc.L3RpcCallback.update_floatingip_statuses {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 08 16:19:26.539096 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ceb92e8-f6e7-4a50-ad24-4d046294ddb7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Pushing event deleted for resources: {'Port': ['ID=3d6fe3bf-2ff3-45bc-bd54-49d907904801,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:19:26.590991 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9ceb92e8-f6e7-4a50-ad24-4d046294ddb7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for floatingip, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:26.593431 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9ceb92e8-f6e7-4a50-ad24-4d046294ddb7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for floatingip, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:26.594635 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-9ceb92e8-f6e7-4a50-ad24-4d046294ddb7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "DELETE /v2.0/floatingips/d4af2e67-2c52-4ceb-8852-69c61f0e2870 HTTP/1.1" status: 204 len: 168 time: 0.4448996 Nov 08 16:19:26.863639 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 40896) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:19:26.868258 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-1c76fcda-22aa-4ff9-8667-193df3ea0763 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Request body: {'security_group': {'name': 'tempest-securitygroup--602507164', 'description': 'tempest-description--1140689243'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:19:26.890919 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-1c76fcda-22aa-4ff9-8667-193df3ea0763 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:26.953760 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-1c76fcda-22aa-4ff9-8667-193df3ea0763 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:26.957146 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-1c76fcda-22aa-4ff9-8667-193df3ea0763 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:26.985473 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-1c76fcda-22aa-4ff9-8667-193df3ea0763 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:26.986696 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-1c76fcda-22aa-4ff9-8667-193df3ea0763 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.1220546 Nov 08 16:19:26.988525 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c76fcda-22aa-4ff9-8667-193df3ea0763 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:19:26.989612 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 40898) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:19:26.995344 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-f1b5ff36-afc8-482f-b2cf-4758acb1779d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Request body: {'security_group_rule': {'security_group_id': 'f26a5a81-43d9-4fa8-90aa-bc881ef38d5c', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:19:27.009995 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ce13f3c-933d-4f16-809d-e44b8b38b2ba None None] New status for floating IP d4af2e67-2c52-4ceb-8852-69c61f0e2870: DOWN {{(pid=101247) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 16:19:27.020901 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f1b5ff36-afc8-482f-b2cf-4758acb1779d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:27.073942 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f1b5ff36-afc8-482f-b2cf-4758acb1779d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:27.077970 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f1b5ff36-afc8-482f-b2cf-4758acb1779d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:27.095204 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1b5ff36-afc8-482f-b2cf-4758acb1779d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=64e215ea-d579-433e-a032-8148fb85f8e5,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:19:27.105184 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1b5ff36-afc8-482f-b2cf-4758acb1779d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:27.105550 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1b5ff36-afc8-482f-b2cf-4758acb1779d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:27.105893 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1b5ff36-afc8-482f-b2cf-4758acb1779d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:27.106538 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1b5ff36-afc8-482f-b2cf-4758acb1779d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:27.106926 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1b5ff36-afc8-482f-b2cf-4758acb1779d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:27.107201 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1b5ff36-afc8-482f-b2cf-4758acb1779d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:27.107518 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1b5ff36-afc8-482f-b2cf-4758acb1779d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:27.107913 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1b5ff36-afc8-482f-b2cf-4758acb1779d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:27.108148 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1b5ff36-afc8-482f-b2cf-4758acb1779d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:27.108485 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1b5ff36-afc8-482f-b2cf-4758acb1779d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:27.108778 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1b5ff36-afc8-482f-b2cf-4758acb1779d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:27.109105 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1b5ff36-afc8-482f-b2cf-4758acb1779d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:27.114175 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-f1b5ff36-afc8-482f-b2cf-4758acb1779d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:27.118088 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-f1b5ff36-afc8-482f-b2cf-4758acb1779d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1274662 Nov 08 16:19:27.118324 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 40900) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:19:27.122785 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-1820202a-5f88-4dfe-ac6f-17db12f9b3f1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Request body: {'security_group_rule': {'security_group_id': 'f26a5a81-43d9-4fa8-90aa-bc881ef38d5c', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:19:27.148120 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-1820202a-5f88-4dfe-ac6f-17db12f9b3f1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:27.204789 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-1820202a-5f88-4dfe-ac6f-17db12f9b3f1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:27.208001 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-1820202a-5f88-4dfe-ac6f-17db12f9b3f1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:27.225251 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1820202a-5f88-4dfe-ac6f-17db12f9b3f1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3e898c00-8e54-4579-8d1d-b96c8c2fdf1b,revision_number=0']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:19:27.232806 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-1820202a-5f88-4dfe-ac6f-17db12f9b3f1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:27.234065 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-1820202a-5f88-4dfe-ac6f-17db12f9b3f1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1146586 Nov 08 16:19:27.236999 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 40902) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:19:27.241087 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-6d28c506-1e3c-4ee2-b906-b59a30ed3389 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Request body: {'floatingip': {'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:19:27.263361 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6d28c506-1e3c-4ee2-b906-b59a30ed3389 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for floatingip, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:27.354949 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6d28c506-1e3c-4ee2-b906-b59a30ed3389 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:27.458859 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [None req-6d28c506-1e3c-4ee2-b906-b59a30ed3389 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Allocated IP 172.27.3.63 (68f46265-b42a-49a0-8d57-f9362045cd9b/4728e4be-5a19-43c0-89cf-ced2a190645d/8eb1e1e9-fa10-456e-aefb-54510a78d6d6) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:19:27.557266 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6d28c506-1e3c-4ee2-b906-b59a30ed3389 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:27.588489 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6d28c506-1e3c-4ee2-b906-b59a30ed3389 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:27.627778 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d28c506-1e3c-4ee2-b906-b59a30ed3389 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Network 68f46265-b42a-49a0-8d57-f9362045cd9b is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:19:27.630478 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-6d28c506-1e3c-4ee2-b906-b59a30ed3389 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:19:27.636565 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d28c506-1e3c-4ee2-b906-b59a30ed3389 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:19:27.660756 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d28c506-1e3c-4ee2-b906-b59a30ed3389 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Pushing event updated for resources: {'Port': ['ID=8eb1e1e9-fa10-456e-aefb-54510a78d6d6,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:19:27.724049 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6d28c506-1e3c-4ee2-b906-b59a30ed3389 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:27.755823 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6d28c506-1e3c-4ee2-b906-b59a30ed3389 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:27.897993 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6d28c506-1e3c-4ee2-b906-b59a30ed3389 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:27.902322 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6d28c506-1e3c-4ee2-b906-b59a30ed3389 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:27.975161 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d28c506-1e3c-4ee2-b906-b59a30ed3389 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Pushing event updated for resources: {'Port': ['ID=8eb1e1e9-fa10-456e-aefb-54510a78d6d6,revision_number=2']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:19:27.984501 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6d28c506-1e3c-4ee2-b906-b59a30ed3389 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-2032271'] for floatingip, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:27.999144 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6d28c506-1e3c-4ee2-b906-b59a30ed3389 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for floatingip, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:28.000494 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-6d28c506-1e3c-4ee2-b906-b59a30ed3389 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 0.7625880 Nov 08 16:19:28.191326 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-4a695e45-95ae-464d-b2ba-480885adb024 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?name=tempest-securitygroup--602507164&fields=id&tenant_id=10a4252a63bf480d93d2e9da15bb8efd HTTP/1.1" status: 200 len: 267 time: 0.0416503 Nov 08 16:19:28.292068 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-e771bd48-09d3-4a89-b86c-61105b8c6c5c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:28.293516 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-e771bd48-09d3-4a89-b86c-61105b8c6c5c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/networks?id=e0e08679-82fe-47eb-90b6-49a1713fdaca HTTP/1.1" status: 200 len: 817 time: 0.0951760 Nov 08 16:19:28.308423 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-20689a35-19d2-4058-b50c-704d6fa0c030 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/quotas/10a4252a63bf480d93d2e9da15bb8efd HTTP/1.1" status: 200 len: 375 time: 0.0091510 Nov 08 16:19:28.363512 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-4c6851b9-6b8c-4c5f-825a-28b2ffbda7b8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?tenant_id=10a4252a63bf480d93d2e9da15bb8efd&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0500357 Nov 08 16:19:28.457756 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-6f2a2185-a464-4ff3-82dd-48f2e8bd4ba6 service neutron] 10.222.0.37 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0826333 Nov 08 16:19:28.547584 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-629b11d6-30f8-4473-8b7c-1e4831475c3b service neutron] 10.222.0.37 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0834181 Nov 08 16:19:28.699874 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-95993870-9821-41e8-b075-d738befac8bc req-23c96a07-a6c0-4b7e-8a5f-2483de49c978 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 210 time: 0.0267022 Nov 08 16:19:29.593893 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-e4d60e2e-d813-4e1e-a35a-39546e450a32 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:29.595317 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-e4d60e2e-d813-4e1e-a35a-39546e450a32 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.25 "GET /v2.0/networks?id=e0e08679-82fe-47eb-90b6-49a1713fdaca HTTP/1.1" status: 200 len: 817 time: 0.0985179 Nov 08 16:19:29.660324 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-de6515fd-1b0e-4bce-a356-21d97d200a4a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.25 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=10a4252a63bf480d93d2e9da15bb8efd HTTP/1.1" status: 200 len: 379 time: 0.0550945 Nov 08 16:19:29.675341 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-f18482d1-cd43-441b-ac8c-bd6c76c54707 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Request body: {'port': {'device_id': 'f0c4ded0-3419-458b-ab12-da310a2b2fd7', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'admin_state_up': True, 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'security_groups': ['f26a5a81-43d9-4fa8-90aa-bc881ef38d5c']}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:19:29.800849 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-88671e54-b4cf-4c41-ab4e-d6ba0a468a44 req-e78b4e79-6c6e-441f-88b0-3a215f34e61b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 210 time: 0.0297847 Nov 08 16:19:29.801456 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-f18482d1-cd43-441b-ac8c-bd6c76c54707 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Made reservation on behalf of 10a4252a63bf480d93d2e9da15bb8efd for: {'port': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:19:29.804776 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-f18482d1-cd43-441b-ac8c-bd6c76c54707 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:29.928515 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-f18482d1-cd43-441b-ac8c-bd6c76c54707 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Allocated IP 172.20.0.14 (e0e08679-82fe-47eb-90b6-49a1713fdaca/fc52ff8b-1692-487b-a0de-f6290e65d880/b3094cea-72ef-41cf-ac88-a6d678f0fb09) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:19:30.066440 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-f18482d1-cd43-441b-ac8c-bd6c76c54707 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:30.099380 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-f18482d1-cd43-441b-ac8c-bd6c76c54707 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:30.141114 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-f18482d1-cd43-441b-ac8c-bd6c76c54707 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Network e0e08679-82fe-47eb-90b6-49a1713fdaca is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:19:30.146016 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-f18482d1-cd43-441b-ac8c-bd6c76c54707 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:19:30.149688 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-f18482d1-cd43-441b-ac8c-bd6c76c54707 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:19:30.173292 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f18482d1-cd43-441b-ac8c-bd6c76c54707 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Pushing event updated for resources: {'Port': ['ID=b3094cea-72ef-41cf-ac88-a6d678f0fb09,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:19:30.202308 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-f18482d1-cd43-441b-ac8c-bd6c76c54707 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:30.202783 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-f18482d1-cd43-441b-ac8c-bd6c76c54707 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:30.226233 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-f18482d1-cd43-441b-ac8c-bd6c76c54707 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5551298 Nov 08 16:19:30.239694 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-85c3b97b-19c4-47ff-8c5b-e2b40309f0e0 service neutron] Request body: {'port': {'device_id': 'f0c4ded0-3419-458b-ab12-da310a2b2fd7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81618'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:19:30.294814 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-85c3b97b-19c4-47ff-8c5b-e2b40309f0e0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:30.362184 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-af84a3d4-9998-45ba-9ff4-f84438592786 None None] Provisioning complete for port b3094cea-72ef-41cf-ac88-a6d678f0fb09 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:19:30.362793 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-af84a3d4-9998-45ba-9ff4-f84438592786 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:30.398100 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-af84a3d4-9998-45ba-9ff4-f84438592786 None None] Port b3094cea-72ef-41cf-ac88-a6d678f0fb09 cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:19:30.550336 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-85c3b97b-19c4-47ff-8c5b-e2b40309f0e0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b3094cea-72ef-41cf-ac88-a6d678f0fb09 {{(pid=101244) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:19:30.557390 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-85c3b97b-19c4-47ff-8c5b-e2b40309f0e0 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:30.568661 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.provisioning_blocks [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-85c3b97b-19c4-47ff-8c5b-e2b40309f0e0 service neutron] Transition to ACTIVE for port object b3094cea-72ef-41cf-ac88-a6d678f0fb09 will not be triggered until provisioned by entity L2. {{(pid=101244) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 16:19:30.572805 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-85c3b97b-19c4-47ff-8c5b-e2b40309f0e0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:30.638811 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85c3b97b-19c4-47ff-8c5b-e2b40309f0e0 service neutron] Pushing event updated for resources: {'Port': ['ID=b3094cea-72ef-41cf-ac88-a6d678f0fb09,revision_number=2']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:19:30.689427 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-85c3b97b-19c4-47ff-8c5b-e2b40309f0e0 service neutron] Attempting to bind port b3094cea-72ef-41cf-ac88-a6d678f0fb09 on host hv-cinder-81618 for vnic_type normal with profile {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:19:30.689836 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-85c3b97b-19c4-47ff-8c5b-e2b40309f0e0 service neutron] Attempting to bind port b3094cea-72ef-41cf-ac88-a6d678f0fb09 by drivers openvswitch,hyperv on host hv-cinder-81618 at level 0 using segments [{'id': '13aab495-f4c4-414c-b50c-fd22b4e0ef0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 188, 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca'}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:19:30.690163 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-85c3b97b-19c4-47ff-8c5b-e2b40309f0e0 service neutron] Attempting to bind port b3094cea-72ef-41cf-ac88-a6d678f0fb09 on network e0e08679-82fe-47eb-90b6-49a1713fdaca {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:19:30.694651 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-85c3b97b-19c4-47ff-8c5b-e2b40309f0e0 service neutron] Port b3094cea-72ef-41cf-ac88-a6d678f0fb09 on network e0e08679-82fe-47eb-90b6-49a1713fdaca not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81618 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 16:19:30.694965 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-85c3b97b-19c4-47ff-8c5b-e2b40309f0e0 service neutron] Attempting to bind port b3094cea-72ef-41cf-ac88-a6d678f0fb09 on network e0e08679-82fe-47eb-90b6-49a1713fdaca {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:19:30.700329 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-85c3b97b-19c4-47ff-8c5b-e2b40309f0e0 service neutron] Checking agent: {'id': '54bf9779-c14d-412a-90fc-96b4a6589d5a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81618', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'started_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 19, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:19:30.700657 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-85c3b97b-19c4-47ff-8c5b-e2b40309f0e0 service neutron] Checking segment: {'id': '13aab495-f4c4-414c-b50c-fd22b4e0ef0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 188, 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:19:30.701033 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-85c3b97b-19c4-47ff-8c5b-e2b40309f0e0 service neutron] Bound using segment: {'id': '13aab495-f4c4-414c-b50c-fd22b4e0ef0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 188, 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca'} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:19:30.701451 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-85c3b97b-19c4-47ff-8c5b-e2b40309f0e0 service neutron] Bound port: b3094cea-72ef-41cf-ac88-a6d678f0fb09, host: hv-cinder-81618, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '13aab495-f4c4-414c-b50c-fd22b4e0ef0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 188, 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca'}}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:19:30.701827 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-85c3b97b-19c4-47ff-8c5b-e2b40309f0e0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:30.766211 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-85c3b97b-19c4-47ff-8c5b-e2b40309f0e0 service neutron] For port b3094cea-72ef-41cf-ac88-a6d678f0fb09, host hv-cinder-81618, cleared binding levels {{(pid=101244) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:19:30.769108 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-85c3b97b-19c4-47ff-8c5b-e2b40309f0e0 service neutron] For port b3094cea-72ef-41cf-ac88-a6d678f0fb09, host hv-cinder-81618, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=b3094cea-72ef-41cf-ac88-a6d678f0fb09,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101244) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:19:30.774103 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-85c3b97b-19c4-47ff-8c5b-e2b40309f0e0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:30.805440 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-85c3b97b-19c4-47ff-8c5b-e2b40309f0e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:30.806002 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-85c3b97b-19c4-47ff-8c5b-e2b40309f0e0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:30.808443 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-85c3b97b-19c4-47ff-8c5b-e2b40309f0e0 service neutron] 10.222.0.25 "PUT /v2.0/ports/b3094cea-72ef-41cf-ac88-a6d678f0fb09 HTTP/1.1" status: 200 len: 1094 time: 0.5729337 Nov 08 16:19:30.810382 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f0c4ded0-3419-458b-ab12-da310a2b2fd7', 'tag': 'b3094cea-72ef-41cf-ac88-a6d678f0fb09'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:19:30.814099 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7fcd85f9-ac09-4d62-9ae1-9b474952cb45" -d '{"events": [{"name": "network-changed", "server_uuid": "f0c4ded0-3419-458b-ab12-da310a2b2fd7", "tag": "b3094cea-72ef-41cf-ac88-a6d678f0fb09"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:19:30.842078 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85c3b97b-19c4-47ff-8c5b-e2b40309f0e0 service neutron] Pushing event updated for resources: {'Port': ['ID=b3094cea-72ef-41cf-ac88-a6d678f0fb09,revision_number=3']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:19:30.871844 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:19:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a02f34ac-2af8-4805-991c-eb396f736bd7 x-openstack-request-id: req-a02f34ac-2af8-4805-991c-eb396f736bd7 {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:19:30.872054 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f0c4ded0-3419-458b-ab12-da310a2b2fd7", "tag": "b3094cea-72ef-41cf-ac88-a6d678f0fb09", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:19:30.872272 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-a02f34ac-2af8-4805-991c-eb396f736bd7 {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:19:30.872658 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f0c4ded0-3419-458b-ab12-da310a2b2fd7', 'tag': 'b3094cea-72ef-41cf-ac88-a6d678f0fb09', 'status': 'completed', 'code': 200} Nov 08 16:19:30.935122 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-0f07e764-8941-4105-9261-82ef7cc41a3c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:30.936647 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-0f07e764-8941-4105-9261-82ef7cc41a3c service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=10a4252a63bf480d93d2e9da15bb8efd&device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 1097 time: 0.0785260 Nov 08 16:19:30.961322 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1b8c5c-c417-4b54-ba43-5b135d4c33c4 req-aed93f7b-00a8-4062-bdaa-a02541b944db tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:30.963982 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8a1b8c5c-c417-4b54-ba43-5b135d4c33c4 req-aed93f7b-00a8-4062-bdaa-a02541b944db tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0683663 Nov 08 16:19:30.997222 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-40e1f9c2-7cc5-49ac-8d0e-ccd2c29580b0 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b3094cea-72ef-41cf-ac88-a6d678f0fb09 HTTP/1.1" status: 200 len: 217 time: 0.0506830 Nov 08 16:19:31.063969 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8a1b8c5c-c417-4b54-ba43-5b135d4c33c4 req-e112ab05-14a3-4726-bb8f-4c788b565dbc tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0742180 Nov 08 16:19:31.067812 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-44bdb140-f1ad-4424-b0d6-c1ab9688a89c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:31.069197 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-44bdb140-f1ad-4424-b0d6-c1ab9688a89c service neutron] 10.222.0.25 "GET /v2.0/subnets?id=fc52ff8b-1692-487b-a0de-f6290e65d880 HTTP/1.1" status: 200 len: 856 time: 0.0639534 Nov 08 16:19:31.119141 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-d48ec66c-1f13-4419-94b6-86d859ec5018 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:31.120611 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-d48ec66c-1f13-4419-94b6-86d859ec5018 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=e0e08679-82fe-47eb-90b6-49a1713fdaca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0438695 Nov 08 16:19:31.207473 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-eb455773-c180-4d5b-bd72-7db0aa8c44d5 service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0792360 Nov 08 16:19:31.299251 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8d9958ba-3372-4c04-8976-78d9166b9f29 req-4ca65c03-1a55-478c-a18c-1512de56f27c service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0830092 Nov 08 16:19:31.402532 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fcd85f9-ac09-4d62-9ae1-9b474952cb45 req-1b045059-a62f-4505-9faf-8891a27fb472 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:31.404008 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7fcd85f9-ac09-4d62-9ae1-9b474952cb45 req-1b045059-a62f-4505-9faf-8891a27fb472 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=10a4252a63bf480d93d2e9da15bb8efd&device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 1097 time: 0.0402114 Nov 08 16:19:31.496746 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fcd85f9-ac09-4d62-9ae1-9b474952cb45 req-a251c51c-8371-453b-acf8-a66bdee41ccb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:31.498291 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7fcd85f9-ac09-4d62-9ae1-9b474952cb45 req-a251c51c-8371-453b-acf8-a66bdee41ccb service neutron] 10.222.0.25 "GET /v2.0/networks?id=e0e08679-82fe-47eb-90b6-49a1713fdaca HTTP/1.1" status: 200 len: 918 time: 0.0863984 Nov 08 16:19:31.537951 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7fcd85f9-ac09-4d62-9ae1-9b474952cb45 req-5620aa8f-9a00-4145-a55c-999d21645901 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b3094cea-72ef-41cf-ac88-a6d678f0fb09 HTTP/1.1" status: 200 len: 217 time: 0.0325119 Nov 08 16:19:31.585391 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fcd85f9-ac09-4d62-9ae1-9b474952cb45 req-1e303d87-5f41-43ec-a8cf-677b1d1b02e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:31.586903 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7fcd85f9-ac09-4d62-9ae1-9b474952cb45 req-1e303d87-5f41-43ec-a8cf-677b1d1b02e3 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=fc52ff8b-1692-487b-a0de-f6290e65d880 HTTP/1.1" status: 200 len: 856 time: 0.0424502 Nov 08 16:19:31.629854 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fcd85f9-ac09-4d62-9ae1-9b474952cb45 req-5f1df18e-7d65-477c-9cfc-95471193185d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:31.631253 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7fcd85f9-ac09-4d62-9ae1-9b474952cb45 req-5f1df18e-7d65-477c-9cfc-95471193185d service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=e0e08679-82fe-47eb-90b6-49a1713fdaca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0365770 Nov 08 16:19:31.719520 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7fcd85f9-ac09-4d62-9ae1-9b474952cb45 req-53bd7755-bdd3-4160-a9da-fea83af2082f service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0807841 Nov 08 16:19:31.805858 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7fcd85f9-ac09-4d62-9ae1-9b474952cb45 req-b114bd89-aefa-4588-afe8-c6cc8435645f service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0776441 Nov 08 16:19:32.188145 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfd1d0be-efae-450c-a14b-a540022d58e6 req-c13c8f28-c960-4247-968f-edb45254f0ec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:32.189589 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bfd1d0be-efae-450c-a14b-a540022d58e6 req-c13c8f28-c960-4247-968f-edb45254f0ec tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0517991 Nov 08 16:19:32.234382 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bfd1d0be-efae-450c-a14b-a540022d58e6 req-a1b3c4fb-d790-4b80-bef0-aef7bd43ac88 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0390108 Nov 08 16:19:33.350508 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-961ef5a0-b4c1-466d-b225-55d052552d91 req-8a077ebb-8318-42c0-a42f-7d29d30d547e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:33.351860 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-961ef5a0-b4c1-466d-b225-55d052552d91 req-8a077ebb-8318-42c0-a42f-7d29d30d547e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0473225 Nov 08 16:19:33.396986 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-961ef5a0-b4c1-466d-b225-55d052552d91 req-5a9f4604-32d8-48ba-94d6-2305f873303b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0386193 Nov 08 16:19:34.337008 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device b3094cea-72ef-41cf-ac88-a6d678f0fb09 details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:19:34.426709 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port b3094cea-72ef-41cf-ac88-a6d678f0fb09, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=b3094cea-72ef-41cf-ac88-a6d678f0fb09,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:19:34.441073 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': 'b3094cea-72ef-41cf-ac88-a6d678f0fb09', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'port_id': 'b3094cea-72ef-41cf-ac88-a6d678f0fb09', 'mac_address': 'fa:16:3e:a2:9b:c1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 188, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:19:34.477186 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:34.489607 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b3094cea-72ef-41cf-ac88-a6d678f0fb09 {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:19:34.508707 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port b3094cea-72ef-41cf-ac88-a6d678f0fb09, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=b3094cea-72ef-41cf-ac88-a6d678f0fb09,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:19:34.513139 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-883f8f0a-7423-46b7-8f6e-4cd5fbee92b0 req-a064ff0d-bea6-4407-a00c-279ccc2d2aa3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:34.513968 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:34.515816 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-883f8f0a-7423-46b7-8f6e-4cd5fbee92b0 req-a064ff0d-bea6-4407-a00c-279ccc2d2aa3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0480371 Nov 08 16:19:34.559434 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=b3094cea-72ef-41cf-ac88-a6d678f0fb09,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:19:34.564618 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-883f8f0a-7423-46b7-8f6e-4cd5fbee92b0 req-68515fe8-2ae0-49a1-a0f2-f2ce883ad333 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434010 Nov 08 16:19:34.566415 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:34.566794 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:34.567218 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:34.567544 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:34.567870 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:34.568198 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:34.568521 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:34.568844 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:34.569167 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:34.569485 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:34.569825 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:34.570144 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:34.908730 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['b3094cea-72ef-41cf-ac88-a6d678f0fb09'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:19:35.682459 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d830a9e0-8d8e-47f9-9420-6973474f0d0b req-480cb239-69c9-4368-88e2-82cdae1c87ab tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:35.683918 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d830a9e0-8d8e-47f9-9420-6973474f0d0b req-480cb239-69c9-4368-88e2-82cdae1c87ab tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 945 time: 0.0476763 Nov 08 16:19:35.729966 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d830a9e0-8d8e-47f9-9420-6973474f0d0b req-36194a03-9cec-4b2d-b684-1140ce791108 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402198 Nov 08 16:19:36.356523 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device b3094cea-72ef-41cf-ac88-a6d678f0fb09 up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:19:36.403447 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning for port b3094cea-72ef-41cf-ac88-a6d678f0fb09 completed by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 16:19:36.407286 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port b3094cea-72ef-41cf-ac88-a6d678f0fb09 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:19:36.407650 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:36.484276 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:36.507934 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f0c4ded0-3419-458b-ab12-da310a2b2fd7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b3094cea-72ef-41cf-ac88-a6d678f0fb09'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:19:36.510701 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d073fd35-be75-41cb-84c5-ec79f5f2d5e8" -d '{"events": [{"server_uuid": "f0c4ded0-3419-458b-ab12-da310a2b2fd7", "name": "network-vif-plugged", "status": "completed", "tag": "b3094cea-72ef-41cf-ac88-a6d678f0fb09"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:19:36.521102 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port b3094cea-72ef-41cf-ac88-a6d678f0fb09, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=b3094cea-72ef-41cf-ac88-a6d678f0fb09,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:19:36.525182 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:36.551776 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:19:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c60f07a3-0152-4256-871a-823df755dbde x-openstack-request-id: req-c60f07a3-0152-4256-871a-823df755dbde {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:19:36.552045 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f0c4ded0-3419-458b-ab12-da310a2b2fd7", "name": "network-vif-plugged", "status": "completed", "tag": "b3094cea-72ef-41cf-ac88-a6d678f0fb09", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:19:36.552302 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-c60f07a3-0152-4256-871a-823df755dbde {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:19:36.552681 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f0c4ded0-3419-458b-ab12-da310a2b2fd7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b3094cea-72ef-41cf-ac88-a6d678f0fb09', 'code': 200} Nov 08 16:19:36.574763 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=b3094cea-72ef-41cf-ac88-a6d678f0fb09,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:19:36.715942 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ff152bd-947c-421c-b16e-750cceb17ddf req-9a1d4b98-d6fa-4179-a225-8bd68234a4d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:36.717306 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7ff152bd-947c-421c-b16e-750cceb17ddf req-9a1d4b98-d6fa-4179-a225-8bd68234a4d2 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 1099 time: 0.0386395 Nov 08 16:19:36.760561 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7ff152bd-947c-421c-b16e-750cceb17ddf req-1016ca61-cba4-4242-bdd1-f83b6c50579e service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0352886 Nov 08 16:19:36.847585 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53b453b4-e7ec-456f-8b52-3670445d229a req-f1e0a75b-03bd-4188-be48-ac3be875edea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:36.849028 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-53b453b4-e7ec-456f-8b52-3670445d229a req-f1e0a75b-03bd-4188-be48-ac3be875edea tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.0500333 Nov 08 16:19:36.895203 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-53b453b4-e7ec-456f-8b52-3670445d229a req-2ce0ea3b-e2df-40f4-b239-4c4ff9fd57b9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400333 Nov 08 16:19:38.012255 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b25e9a96-96df-43cc-a260-d2729275ade4 req-9aadd501-fe07-462e-b590-509235714c83 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:38.013732 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b25e9a96-96df-43cc-a260-d2729275ade4 req-9aadd501-fe07-462e-b590-509235714c83 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.0479212 Nov 08 16:19:38.059140 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b25e9a96-96df-43cc-a260-d2729275ade4 req-b4ecd179-4675-45be-8563-635edcf1cd7d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396295 Nov 08 16:19:38.123975 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-fa9b3943-7cc2-461a-a549-68e82a09babe None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:39.177980 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea0b64ea-6c79-436c-87b0-2cb44340a1bf req-43e74710-0261-4d6a-9c91-7875b6f2c8d3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:39.179430 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ea0b64ea-6c79-436c-87b0-2cb44340a1bf req-43e74710-0261-4d6a-9c91-7875b6f2c8d3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.0510802 Nov 08 16:19:39.223883 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ea0b64ea-6c79-436c-87b0-2cb44340a1bf req-556bfed9-faf0-4585-9ad2-493d319f735a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0382364 Nov 08 16:19:39.335603 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfa77877-7607-4aac-8b98-6dfc5828b46b req-666b4f4e-c6e5-4e02-9b16-9f558092966a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:39.336965 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dfa77877-7607-4aac-8b98-6dfc5828b46b req-666b4f4e-c6e5-4e02-9b16-9f558092966a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.0469346 Nov 08 16:19:39.345694 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 40968) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:19:39.349943 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-f9d1bc89-5ed2-4bc7-9038-8a4299e850b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Request body: {'floatingip': {'port_id': 'b3094cea-72ef-41cf-ac88-a6d678f0fb09'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:19:39.387141 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f9d1bc89-5ed2-4bc7-9038-8a4299e850b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for floatingip, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:40.029214 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f9d1bc89-5ed2-4bc7-9038-8a4299e850b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:40.032912 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f9d1bc89-5ed2-4bc7-9038-8a4299e850b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-2032271'] for floatingip, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:40.129644 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.db.l3_db [None req-f9d1bc89-5ed2-4bc7-9038-8a4299e850b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Floating IP 393a95ad-ba5e-4909-9857-e0f0e9617832 associated. External IP: 172.27.3.63, port: b3094cea-72ef-41cf-ac88-a6d678f0fb09. Nov 08 16:19:40.328537 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f9d1bc89-5ed2-4bc7-9038-8a4299e850b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Router e5087790-dc76-4f18-81a3-548feaf21791 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:19:40.432400 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f9d1bc89-5ed2-4bc7-9038-8a4299e850b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:19:40.437252 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f9d1bc89-5ed2-4bc7-9038-8a4299e850b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for floatingip, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:40.442127 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59706173-b196-4afe-8f21-cc976a1359c8 None None] Sync routers for ids ['e5087790-dc76-4f18-81a3-548feaf21791'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:19:40.451957 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59706173-b196-4afe-8f21-cc976a1359c8 None None] Routers {'e5087790-dc76-4f18-81a3-548feaf21791'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:19:40.452554 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-59706173-b196-4afe-8f21-cc976a1359c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:19:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['e5087790-dc76-4f18-81a3-548feaf21791'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:19:40.464630 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-f9d1bc89-5ed2-4bc7-9038-8a4299e850b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "PUT /v2.0/floatingips/393a95ad-ba5e-4909-9857-e0f0e9617832 HTTP/1.1" status: 200 len: 991 time: 1.1179032 Nov 08 16:19:40.465295 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f0c4ded0-3419-458b-ab12-da310a2b2fd7', 'tag': 'b3094cea-72ef-41cf-ac88-a6d678f0fb09'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:19:40.467749 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0812eeec-0660-48f4-802d-f3f6c6ae1cdb" -d '{"events": [{"name": "network-changed", "server_uuid": "f0c4ded0-3419-458b-ab12-da310a2b2fd7", "tag": "b3094cea-72ef-41cf-ac88-a6d678f0fb09"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:19:40.504023 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:19:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7281e232-9f98-42e6-8a1b-168af9e0becc x-openstack-request-id: req-7281e232-9f98-42e6-8a1b-168af9e0becc {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:19:40.504318 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f0c4ded0-3419-458b-ab12-da310a2b2fd7", "tag": "b3094cea-72ef-41cf-ac88-a6d678f0fb09", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:19:40.504572 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-7281e232-9f98-42e6-8a1b-168af9e0becc {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:19:40.504977 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f0c4ded0-3419-458b-ab12-da310a2b2fd7', 'tag': 'b3094cea-72ef-41cf-ac88-a6d678f0fb09', 'status': 'completed', 'code': 200} Nov 08 16:19:40.558779 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-59706173-b196-4afe-8f21-cc976a1359c8 None None] Set router e5087790-dc76-4f18-81a3-548feaf21791 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:19:40.582386 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0812eeec-0660-48f4-802d-f3f6c6ae1cdb req-47d8a3b9-e390-4aee-b59d-70974f58b810 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:40.583820 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0812eeec-0660-48f4-802d-f3f6c6ae1cdb req-47d8a3b9-e390-4aee-b59d-70974f58b810 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=10a4252a63bf480d93d2e9da15bb8efd&device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 1099 time: 0.0410018 Nov 08 16:19:40.610154 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-a6e25396-2b27-4eb8-a863-3b96ae49d9fb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:40.678736 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0812eeec-0660-48f4-802d-f3f6c6ae1cdb req-f71a1c11-5e2b-4be9-b69d-97e9e717bff2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:40.680215 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0812eeec-0660-48f4-802d-f3f6c6ae1cdb req-f71a1c11-5e2b-4be9-b69d-97e9e717bff2 service neutron] 10.222.0.25 "GET /v2.0/networks?id=e0e08679-82fe-47eb-90b6-49a1713fdaca HTTP/1.1" status: 200 len: 918 time: 0.0882452 Nov 08 16:19:40.744957 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0812eeec-0660-48f4-802d-f3f6c6ae1cdb req-8701a3ee-0d98-43d9-ab8a-d4ed59c5f397 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b3094cea-72ef-41cf-ac88-a6d678f0fb09 HTTP/1.1" status: 200 len: 999 time: 0.0568051 Nov 08 16:19:40.793112 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-59706173-b196-4afe-8f21-cc976a1359c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'name': 'tempest-AttachVolumeShelveTestJSON-1204269590-router', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118'}], 'enable_snat': True}, 'gw_port_id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:01Z', 'updated_at': '2021-11-08T16:11:11Z', 'revision_number': 4, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'gw_port': {'id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:db:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': '393a95ad-ba5e-4909-9857-e0f0e9617832', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'floating_ip_address': '172.27.3.63', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'port_id': 'b3094cea-72ef-41cf-ac88-a6d678f0fb09', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 543, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'mac_address': 'fa:16:3e:a2:9b:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0c4ded0-3419-458b-ab12-da310a2b2fd7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:19:27Z', 'updated_at': '2021-11-08T16:19:39Z', 'revision_number': 1, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9e08c20e-219c-4cd8-b6fe-30829b440d06', 'name': '', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'mac_address': 'fa:16:3e:e6:20:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:09Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 5, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'subnets': [{'id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:19:40.799264 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0812eeec-0660-48f4-802d-f3f6c6ae1cdb req-41111502-3603-42e7-b789-6621931e8082 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:40.800749 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0812eeec-0660-48f4-802d-f3f6c6ae1cdb req-41111502-3603-42e7-b789-6621931e8082 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=fc52ff8b-1692-487b-a0de-f6290e65d880 HTTP/1.1" status: 200 len: 856 time: 0.0485094 Nov 08 16:19:40.818461 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59706173-b196-4afe-8f21-cc976a1359c8 None None] Checking router: e5087790-dc76-4f18-81a3-548feaf21791 for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:19:40.826616 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59706173-b196-4afe-8f21-cc976a1359c8 None None] Routers {'e5087790-dc76-4f18-81a3-548feaf21791'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:19:40.827218 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-59706173-b196-4afe-8f21-cc976a1359c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:19:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['e5087790-dc76-4f18-81a3-548feaf21791'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:19:40.846727 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0812eeec-0660-48f4-802d-f3f6c6ae1cdb req-9f586e6b-c4e9-415b-abbf-60095a241bb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:40.848194 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0812eeec-0660-48f4-802d-f3f6c6ae1cdb req-9f586e6b-c4e9-415b-abbf-60095a241bb7 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=e0e08679-82fe-47eb-90b6-49a1713fdaca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0383193 Nov 08 16:19:40.934018 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-59706173-b196-4afe-8f21-cc976a1359c8 None None] Set router e5087790-dc76-4f18-81a3-548feaf21791 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:19:40.941966 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0812eeec-0660-48f4-802d-f3f6c6ae1cdb req-9170612b-1507-4152-b993-bdada8e3cd25 service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0843945 Nov 08 16:19:41.046213 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0812eeec-0660-48f4-802d-f3f6c6ae1cdb req-5266c317-01db-4165-94ba-f3f56a89e7c2 service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0894170 Nov 08 16:19:41.158703 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-59706173-b196-4afe-8f21-cc976a1359c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'name': 'tempest-AttachVolumeShelveTestJSON-1204269590-router', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118'}], 'enable_snat': True}, 'gw_port_id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:01Z', 'updated_at': '2021-11-08T16:11:11Z', 'revision_number': 4, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'gw_port': {'id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:db:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': '393a95ad-ba5e-4909-9857-e0f0e9617832', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'floating_ip_address': '172.27.3.63', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'port_id': 'b3094cea-72ef-41cf-ac88-a6d678f0fb09', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 543, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'mac_address': 'fa:16:3e:a2:9b:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0c4ded0-3419-458b-ab12-da310a2b2fd7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:19:27Z', 'updated_at': '2021-11-08T16:19:39Z', 'revision_number': 1, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9e08c20e-219c-4cd8-b6fe-30829b440d06', 'name': '', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'mac_address': 'fa:16:3e:e6:20:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:09Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 5, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'subnets': [{'id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:19:41.183153 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59706173-b196-4afe-8f21-cc976a1359c8 None None] The sync data for ids ['e5087790-dc76-4f18-81a3-548feaf21791'] in dv-cinder-816187-2-iscsi is: [{'id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'name': 'tempest-AttachVolumeShelveTestJSON-1204269590-router', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118'}], 'enable_snat': True}, 'gw_port_id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:01Z', 'updated_at': '2021-11-08T16:11:11Z', 'revision_number': 4, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'gw_port': {'id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:db:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': '393a95ad-ba5e-4909-9857-e0f0e9617832', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'floating_ip_address': '172.27.3.63', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'port_id': 'b3094cea-72ef-41cf-ac88-a6d678f0fb09', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 543, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'mac_address': 'fa:16:3e:a2:9b:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0c4ded0-3419-458b-ab12-da310a2b2fd7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:19:27Z', 'updated_at': '2021-11-08T16:19:39Z', 'revision_number': 1, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9e08c20e-219c-4cd8-b6fe-30829b440d06', 'name': '', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'mac_address': 'fa:16:3e:e6:20:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:09Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 5, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'subnets': [{'id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:19:41.360722 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-003f9750-1ad3-4794-baba-138b39040658 None None] New status for floating IP 393a95ad-ba5e-4909-9857-e0f0e9617832: ACTIVE {{(pid=101247) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 16:19:41.543196 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:43.277006 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:43.962592 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:47.977653 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:50.136704 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-396c2415-2efb-485c-9c7c-11de97dcd3a8 req-8f0ea45a-bcbe-4406-97b3-e7d95826be1b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:50.138204 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-396c2415-2efb-485c-9c7c-11de97dcd3a8 req-8f0ea45a-bcbe-4406-97b3-e7d95826be1b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 984 time: 0.0795546 Nov 08 16:19:50.140038 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-888092bc-0bbb-4382-a043-98525486404d req-655d4226-b440-4f70-bbcd-ee12082ccff0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:50.141376 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-888092bc-0bbb-4382-a043-98525486404d req-655d4226-b440-4f70-bbcd-ee12082ccff0 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=9ad6e5c060034b2ca263bfdcb07fe807&device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 1137 time: 0.0566013 Nov 08 16:19:50.254005 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-396c2415-2efb-485c-9c7c-11de97dcd3a8 req-d8441a83-97d1-4325-812d-84f12b80d87f tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&id=1d27de4f-b93c-4054-9b9d-62a7c87a8620&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1096432 Nov 08 16:19:50.273195 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-888092bc-0bbb-4382-a043-98525486404d req-c721bbe2-8b2a-4939-bf1d-58d5300f1810 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:50.274802 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-888092bc-0bbb-4382-a043-98525486404d req-c721bbe2-8b2a-4939-bf1d-58d5300f1810 service neutron] 10.222.0.25 "GET /v2.0/networks?id=52eb1d65-dc7c-45c5-9521-97cb18715837 HTTP/1.1" status: 200 len: 915 time: 0.1238394 Nov 08 16:19:50.352180 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-888092bc-0bbb-4382-a043-98525486404d req-5a0e6040-3c28-436e-9f16-c242a9e932c8 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=304e385a-c4e3-48f0-8723-230b5da69dc3 HTTP/1.1" status: 200 len: 1001 time: 0.0610647 Nov 08 16:19:50.402130 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-888092bc-0bbb-4382-a043-98525486404d req-9c3a5759-f04e-43b3-b30d-ab56c4685384 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:50.403526 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-888092bc-0bbb-4382-a043-98525486404d req-9c3a5759-f04e-43b3-b30d-ab56c4685384 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=12999abd-2828-4905-aed0-938c2f27aed8 HTTP/1.1" status: 200 len: 853 time: 0.0430615 Nov 08 16:19:50.451420 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-888092bc-0bbb-4382-a043-98525486404d req-20217aa6-e953-470a-aba6-28ad4bfb6f2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:50.452830 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-888092bc-0bbb-4382-a043-98525486404d req-20217aa6-e953-470a-aba6-28ad4bfb6f2c service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=52eb1d65-dc7c-45c5-9521-97cb18715837&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0371804 Nov 08 16:19:50.546395 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-888092bc-0bbb-4382-a043-98525486404d req-33b0db50-984c-4ff7-80b5-1eea9143eb33 service neutron] 10.222.0.25 "GET /v2.0/networks/52eb1d65-dc7c-45c5-9521-97cb18715837?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0826502 Nov 08 16:19:50.632647 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-888092bc-0bbb-4382-a043-98525486404d req-2ebf03d9-5817-4595-97da-c82431be69e0 service neutron] 10.222.0.25 "GET /v2.0/networks/52eb1d65-dc7c-45c5-9521-97cb18715837?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0779340 Nov 08 16:19:51.370954 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fdc935c-fe8a-46ef-8432-9f7ece47d27b req-b130fe58-fbf1-415f-ba52-9166f9e485fa tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:51.372468 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7fdc935c-fe8a-46ef-8432-9f7ece47d27b req-b130fe58-fbf1-415f-ba52-9166f9e485fa tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 984 time: 0.0498667 Nov 08 16:19:51.431045 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7fdc935c-fe8a-46ef-8432-9f7ece47d27b req-6ac2c129-8942-4d02-bd08-b34a647575ea tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&id=1d27de4f-b93c-4054-9b9d-62a7c87a8620&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0523722 Nov 08 16:19:52.550387 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f4ce34b-8ab8-4a0c-9e1c-dc6e2650c4fd req-ef645a47-c3e6-44ae-a82e-1975acfbb543 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:52.551838 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7f4ce34b-8ab8-4a0c-9e1c-dc6e2650c4fd req-ef645a47-c3e6-44ae-a82e-1975acfbb543 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 984 time: 0.0516417 Nov 08 16:19:52.610492 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7f4ce34b-8ab8-4a0c-9e1c-dc6e2650c4fd req-4702ae5a-714c-4aa7-add0-e0dc6bae282e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&id=1d27de4f-b93c-4054-9b9d-62a7c87a8620&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0521054 Nov 08 16:19:53.722827 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae2d8d6-f22f-4381-b7b4-f0f72d2c367e req-63a147fd-5a60-4e77-9e8c-099eaf054b34 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:53.724291 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fae2d8d6-f22f-4381-b7b4-f0f72d2c367e req-63a147fd-5a60-4e77-9e8c-099eaf054b34 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 984 time: 0.0486228 Nov 08 16:19:53.782682 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fae2d8d6-f22f-4381-b7b4-f0f72d2c367e req-55313389-0281-4672-ab32-baa619cdc16b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&id=1d27de4f-b93c-4054-9b9d-62a7c87a8620&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0524058 Nov 08 16:19:54.897628 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60bba265-0b53-4ecb-ac79-81e2fc0050ff req-d4e09361-8a86-4ed4-8cb4-41b0da95133b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:54.899601 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-60bba265-0b53-4ecb-ac79-81e2fc0050ff req-d4e09361-8a86-4ed4-8cb4-41b0da95133b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 984 time: 0.0514033 Nov 08 16:19:54.957101 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-60bba265-0b53-4ecb-ac79-81e2fc0050ff req-af18438d-b5dc-4795-b59e-3c639711fa0b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&id=1d27de4f-b93c-4054-9b9d-62a7c87a8620&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0515549 Nov 08 16:19:55.743671 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6686037b-38eb-4e3f-a893-96fb9d46b777 req-61d2b449-a18a-46ff-a87f-5b63deb8fc5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:55.745148 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6686037b-38eb-4e3f-a893-96fb9d46b777 req-61d2b449-a18a-46ff-a87f-5b63deb8fc5d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0481689 Nov 08 16:19:55.793533 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6686037b-38eb-4e3f-a893-96fb9d46b777 req-99ec86bb-ff81-4d9a-8480-9df72c729e24 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422511 Nov 08 16:19:56.072289 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4e2909c-d330-45f3-a6bd-7d20b0b16712 req-dbfb31e1-3757-4a15-932f-f345a4ef3d51 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:56.073780 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d4e2909c-d330-45f3-a6bd-7d20b0b16712 req-dbfb31e1-3757-4a15-932f-f345a4ef3d51 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 984 time: 0.0472517 Nov 08 16:19:56.136377 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d4e2909c-d330-45f3-a6bd-7d20b0b16712 req-6ad97885-304a-4273-ad6e-2c4d6029d307 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&id=1d27de4f-b93c-4054-9b9d-62a7c87a8620&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0564482 Nov 08 16:19:56.600811 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:19:56.910074 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-111d50c9-3bc3-4034-9cdd-f91e8fb9bedd req-aa7a7338-acd8-4636-825e-fcf79b3c8bcc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:56.911416 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-111d50c9-3bc3-4034-9cdd-f91e8fb9bedd req-aa7a7338-acd8-4636-825e-fcf79b3c8bcc tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0483034 Nov 08 16:19:56.956625 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-111d50c9-3bc3-4034-9cdd-f91e8fb9bedd req-22943622-2694-4b63-8b93-a64ddb94f70e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=293f120d-5959-4f89-b76d-0686f8c34d36&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0389423 Nov 08 16:19:57.147878 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-767d1594-776e-4ae2-a7fa-10a1fb78cdc7 req-161e0eda-8f34-4d27-8563-17b05990468f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:57.149916 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-767d1594-776e-4ae2-a7fa-10a1fb78cdc7 req-161e0eda-8f34-4d27-8563-17b05990468f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.25 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 945 time: 0.0469134 Nov 08 16:19:57.272177 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9070f3b3-5e71-4c74-ab5e-051f346025cb req-ce215316-a738-4d02-89b4-feb55b4ebb67 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:57.273674 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9070f3b3-5e71-4c74-ab5e-051f346025cb req-ce215316-a738-4d02-89b4-feb55b4ebb67 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 984 time: 0.0586472 Nov 08 16:19:57.280572 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-767d1594-776e-4ae2-a7fa-10a1fb78cdc7 req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Deleting port f4784d76-6af7-4b31-a9f3-ee25c9087b51 {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:19:57.280901 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-767d1594-776e-4ae2-a7fa-10a1fb78cdc7 req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:57.396889 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9070f3b3-5e71-4c74-ab5e-051f346025cb req-a3f38c2d-b742-415e-a527-5710eceec2bc tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&id=1d27de4f-b93c-4054-9b9d-62a7c87a8620&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1129968 Nov 08 16:19:57.407996 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-767d1594-776e-4ae2-a7fa-10a1fb78cdc7 req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] For port f4784d76-6af7-4b31-a9f3-ee25c9087b51, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=f4784d76-6af7-4b31-a9f3-ee25c9087b51,segment=NetworkSegment(7651dfae-d245-4d32-b379-dc243d043404),segment_id=7651dfae-d245-4d32-b379-dc243d043404)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:19:57.408647 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-767d1594-776e-4ae2-a7fa-10a1fb78cdc7 req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:57.576415 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-767d1594-776e-4ae2-a7fa-10a1fb78cdc7 req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:57.576764 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-767d1594-776e-4ae2-a7fa-10a1fb78cdc7 req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-2032271'] for floatingip, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:57.577076 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.db.l3_db [req-767d1594-776e-4ae2-a7fa-10a1fb78cdc7 req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Floating IP 764e8a8e-25fe-405c-a49e-e34c538b2ec2 disassociated. External IP: 172.27.3.45, port: f4784d76-6af7-4b31-a9f3-ee25c9087b51. Nov 08 16:19:57.577397 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-767d1594-776e-4ae2-a7fa-10a1fb78cdc7 req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling delete_port for f4784d76-6af7-4b31-a9f3-ee25c9087b51 owned by compute:nova {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:19:57.701189 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-767d1594-776e-4ae2-a7fa-10a1fb78cdc7 req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:57.727231 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Pushing event deleted for resources: {'Port': ['ID=f4784d76-6af7-4b31-a9f3-ee25c9087b51,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:19:57.736657 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:57.737004 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:57.737342 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:57.737673 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:57.738025 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:57.738354 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:57.738679 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:57.738996 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:57.739319 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:57.739638 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:57.739963 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:57.740636 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:19:57.848603 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.l3_agent_scheduler [req-767d1594-776e-4ae2-a7fa-10a1fb78cdc7 req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Router c3f55c44-bed1-4955-9229-dac3c412f010 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:19:57.953452 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-767d1594-776e-4ae2-a7fa-10a1fb78cdc7 req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:19:57.963457 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de213dd9-3de0-4afb-9fdf-d84b1cbe1964 None None] Sync routers for ids ['c3f55c44-bed1-4955-9229-dac3c412f010'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:19:57.973225 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de213dd9-3de0-4afb-9fdf-d84b1cbe1964 None None] Routers {'c3f55c44-bed1-4955-9229-dac3c412f010'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:19:57.973869 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-de213dd9-3de0-4afb-9fdf-d84b1cbe1964 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:19:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['c3f55c44-bed1-4955-9229-dac3c412f010'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:19:57.991370 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-767d1594-776e-4ae2-a7fa-10a1fb78cdc7 req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] No DVR routers for this DVR port f4784d76-6af7-4b31-a9f3-ee25c9087b51 on host hv-cinder-81618 {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:19:57.994218 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-767d1594-776e-4ae2-a7fa-10a1fb78cdc7 req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:57.997455 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-767d1594-776e-4ae2-a7fa-10a1fb78cdc7 req-983fca5d-eacb-4761-9a3d-322518af494f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.25 "DELETE /v2.0/ports/f4784d76-6af7-4b31-a9f3-ee25c9087b51 HTTP/1.1" status: 204 len: 173 time: 0.8408763 Nov 08 16:19:57.997937 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b76ed94d-63f4-4597-be02-f3fc032b85aa', 'name': 'network-vif-deleted', 'tag': 'f4784d76-6af7-4b31-a9f3-ee25c9087b51'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:19:58.000223 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ee977531-6cf6-46ba-9959-6d1004eacf57" -d '{"events": [{"server_uuid": "b76ed94d-63f4-4597-be02-f3fc032b85aa", "name": "network-vif-deleted", "tag": "f4784d76-6af7-4b31-a9f3-ee25c9087b51"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:19:58.070175 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-273531b1-000f-4c99-8432-a81f3640ef6c req-6ea9f84a-4838-4f43-b24a-cc8d487f99a3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=b76ed94d-63f4-4597-be02-f3fc032b85aa HTTP/1.1" status: 200 len: 210 time: 0.0379872 Nov 08 16:19:58.080231 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:19:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5bc160e6-9a13-4587-9d81-e774bf393e5f x-openstack-request-id: req-5bc160e6-9a13-4587-9d81-e774bf393e5f {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:19:58.080231 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b76ed94d-63f4-4597-be02-f3fc032b85aa", "name": "network-vif-deleted", "tag": "f4784d76-6af7-4b31-a9f3-ee25c9087b51", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:19:58.080231 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-5bc160e6-9a13-4587-9d81-e774bf393e5f {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:19:58.080231 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b76ed94d-63f4-4597-be02-f3fc032b85aa', 'name': 'network-vif-deleted', 'tag': 'f4784d76-6af7-4b31-a9f3-ee25c9087b51', 'status': 'completed', 'code': 200} Nov 08 16:19:58.100137 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-de213dd9-3de0-4afb-9fdf-d84b1cbe1964 None None] Set router c3f55c44-bed1-4955-9229-dac3c412f010 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:19:58.311490 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-de213dd9-3de0-4afb-9fdf-d84b1cbe1964 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'name': 'tempest-AttachVolumeTestJSON-272347721-router', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128'}], 'enable_snat': True}, 'gw_port_id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 4, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'gw_port': {'id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:97:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '30759480-5159-4b6e-a269-86ac7d105870', 'name': '', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'mac_address': 'fa:16:3e:86:ee:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:13Z', 'updated_at': '2021-11-08T16:11:28Z', 'revision_number': 5, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'subnets': [{'id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:19:58.336238 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de213dd9-3de0-4afb-9fdf-d84b1cbe1964 None None] Checking router: c3f55c44-bed1-4955-9229-dac3c412f010 for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:19:58.344066 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de213dd9-3de0-4afb-9fdf-d84b1cbe1964 None None] Routers {'c3f55c44-bed1-4955-9229-dac3c412f010'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:19:58.344651 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-de213dd9-3de0-4afb-9fdf-d84b1cbe1964 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:19:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['c3f55c44-bed1-4955-9229-dac3c412f010'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:19:58.573373 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-de213dd9-3de0-4afb-9fdf-d84b1cbe1964 None None] Set router c3f55c44-bed1-4955-9229-dac3c412f010 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:19:58.759210 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dff42eee-f291-4144-b243-22ae5fa372f6 req-b289f192-081e-4e4d-b838-19c83956aa17 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:58.760636 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dff42eee-f291-4144-b243-22ae5fa372f6 req-b289f192-081e-4e4d-b838-19c83956aa17 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 984 time: 0.2906377 Nov 08 16:19:58.771939 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-de213dd9-3de0-4afb-9fdf-d84b1cbe1964 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'name': 'tempest-AttachVolumeTestJSON-272347721-router', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128'}], 'enable_snat': True}, 'gw_port_id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 4, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'gw_port': {'id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:97:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '30759480-5159-4b6e-a269-86ac7d105870', 'name': '', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'mac_address': 'fa:16:3e:86:ee:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:13Z', 'updated_at': '2021-11-08T16:11:28Z', 'revision_number': 5, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'subnets': [{'id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:19:58.801385 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de213dd9-3de0-4afb-9fdf-d84b1cbe1964 None None] The sync data for ids ['c3f55c44-bed1-4955-9229-dac3c412f010'] in dv-cinder-816187-2-iscsi is: [{'id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'name': 'tempest-AttachVolumeTestJSON-272347721-router', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128'}], 'enable_snat': True}, 'gw_port_id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 4, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'gw_port': {'id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:97:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '30759480-5159-4b6e-a269-86ac7d105870', 'name': '', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'mac_address': 'fa:16:3e:86:ee:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:13Z', 'updated_at': '2021-11-08T16:11:28Z', 'revision_number': 5, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'subnets': [{'id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:19:58.819630 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dff42eee-f291-4144-b243-22ae5fa372f6 req-e82e6b02-fc36-4aa2-bbe6-35a7b045f6f2 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&id=1d27de4f-b93c-4054-9b9d-62a7c87a8620&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0529797 Nov 08 16:19:59.004053 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58d15334-3b5e-4bf9-aedd-be82a0fe2ef5 None None] New status for floating IP 764e8a8e-25fe-405c-a49e-e34c538b2ec2: DOWN {{(pid=101247) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 16:19:59.151606 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 41056) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:19:59.210680 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-51b9b598-2f57-4470-903a-fce44f34bb13 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:59.235048 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-51b9b598-2f57-4470-903a-fce44f34bb13 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:59.284309 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-51b9b598-2f57-4470-903a-fce44f34bb13 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:59.286970 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-51b9b598-2f57-4470-903a-fce44f34bb13 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:59.290662 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-51b9b598-2f57-4470-903a-fce44f34bb13 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "DELETE /v2.0/security-groups/293f120d-5959-4f89-b76d-0686f8c34d36 HTTP/1.1" status: 204 len: 168 time: 0.1355147 Nov 08 16:19:59.290950 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 41060) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:19:59.297274 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51b9b598-2f57-4470-903a-fce44f34bb13 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=293f120d-5959-4f89-b76d-0686f8c34d36,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:19:59.305754 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.api.v2.resource [None req-c8fe95bb-905f-4b48-80a3-49d7b0758d74 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] show failed (client error): The resource could not be found. Nov 08 16:19:59.306762 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-c8fe95bb-905f-4b48-80a3-49d7b0758d74 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups/293f120d-5959-4f89-b76d-0686f8c34d36 HTTP/1.1" status: 404 len: 347 time: 0.0148218 Nov 08 16:19:59.310064 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 41062) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:19:59.431795 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-d152b7e9-6729-4621-9c22-3ae6bdac079a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Deleting port 1cec4a34-ed13-464b-b8ae-41a1691cba6d {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:19:59.432050 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d152b7e9-6729-4621-9c22-3ae6bdac079a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:59.504337 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d152b7e9-6729-4621-9c22-3ae6bdac079a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:59.504654 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d152b7e9-6729-4621-9c22-3ae6bdac079a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:59.520270 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-d152b7e9-6729-4621-9c22-3ae6bdac079a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling delete_port for 1cec4a34-ed13-464b-b8ae-41a1691cba6d owned by network:floatingip {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:19:59.643397 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d152b7e9-6729-4621-9c22-3ae6bdac079a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:59.670169 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d152b7e9-6729-4621-9c22-3ae6bdac079a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Pushing event deleted for resources: {'Port': ['ID=1cec4a34-ed13-464b-b8ae-41a1691cba6d,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:19:59.726698 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d152b7e9-6729-4621-9c22-3ae6bdac079a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for floatingip, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:59.729118 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d152b7e9-6729-4621-9c22-3ae6bdac079a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for floatingip, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:19:59.730287 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-d152b7e9-6729-4621-9c22-3ae6bdac079a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "DELETE /v2.0/floatingips/764e8a8e-25fe-405c-a49e-e34c538b2ec2 HTTP/1.1" status: 204 len: 168 time: 0.4193294 Nov 08 16:19:59.935432 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25a6cc7f-4403-4606-a2ac-dc0b3c162c43 req-290f15e9-d955-4dca-bd4e-e3b96185fcab tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:19:59.936887 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-25a6cc7f-4403-4606-a2ac-dc0b3c162c43 req-290f15e9-d955-4dca-bd4e-e3b96185fcab tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 984 time: 0.0483110 Nov 08 16:19:59.999009 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-25a6cc7f-4403-4606-a2ac-dc0b3c162c43 req-acc8de9c-ce24-4c68-bb55-82451680c05b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&id=1d27de4f-b93c-4054-9b9d-62a7c87a8620&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0551422 Nov 08 16:20:00.069862 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 41068) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:20:00.075029 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-3474dd4c-7d7d-45cc-b433-d1f1439e2a2e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1155485669', 'description': 'tempest-description--479467349'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:20:00.097949 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-3474dd4c-7d7d-45cc-b433-d1f1439e2a2e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:00.165144 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-3474dd4c-7d7d-45cc-b433-d1f1439e2a2e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:00.169064 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-3474dd4c-7d7d-45cc-b433-d1f1439e2a2e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:00.193641 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-3474dd4c-7d7d-45cc-b433-d1f1439e2a2e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:00.194889 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-3474dd4c-7d7d-45cc-b433-d1f1439e2a2e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.1234739 Nov 08 16:20:00.198381 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 41070) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:20:00.202987 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-06c8b308-1587-46de-9a6e-d3c895a3a006 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Request body: {'security_group_rule': {'security_group_id': 'd52a633a-858b-44ca-81af-e924516db368', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:20:00.203151 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3474dd4c-7d7d-45cc-b433-d1f1439e2a2e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d52a633a-858b-44ca-81af-e924516db368,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:20:00.231093 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-06c8b308-1587-46de-9a6e-d3c895a3a006 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:00.275191 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-06c8b308-1587-46de-9a6e-d3c895a3a006 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:00.278718 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-06c8b308-1587-46de-9a6e-d3c895a3a006 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:00.295240 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06c8b308-1587-46de-9a6e-d3c895a3a006 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6dc585ae-beff-4a85-9b26-4aead7e02a5c,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:20:00.306127 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-06c8b308-1587-46de-9a6e-d3c895a3a006 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:00.308669 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-06c8b308-1587-46de-9a6e-d3c895a3a006 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1091635 Nov 08 16:20:00.309874 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 41074) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:20:00.314186 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-a22a4c96-4907-4a6f-80f3-23cc855cce31 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Request body: {'security_group_rule': {'security_group_id': 'd52a633a-858b-44ca-81af-e924516db368', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:20:00.341312 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a22a4c96-4907-4a6f-80f3-23cc855cce31 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:00.395750 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a22a4c96-4907-4a6f-80f3-23cc855cce31 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:00.399573 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a22a4c96-4907-4a6f-80f3-23cc855cce31 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:00.417560 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22a4c96-4907-4a6f-80f3-23cc855cce31 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8aab36de-5007-42b8-a304-691c0a70f8f9,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:20:00.422924 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a22a4c96-4907-4a6f-80f3-23cc855cce31 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:00.424141 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-a22a4c96-4907-4a6f-80f3-23cc855cce31 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1133189 Nov 08 16:20:00.427097 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 41076) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:20:00.431830 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-68174683-87f8-4955-a7ee-d28e628002ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Request body: {'floatingip': {'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:20:00.450869 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device f4784d76-6af7-4b31-a9f3-ee25c9087b51 no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:20:00.452569 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-68174683-87f8-4955-a7ee-d28e628002ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for floatingip, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:00.472559 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] No Port match for: f4784d76-6af7-4b31-a9f3-ee25c9087b51 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:20:00.472899 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device f4784d76-6af7-4b31-a9f3-ee25c9087b51 not bound to the agent host hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:20:00.546137 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-68174683-87f8-4955-a7ee-d28e628002ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:00.644496 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_common [None req-68174683-87f8-4955-a7ee-d28e628002ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Allocated IP 172.27.3.195 (68f46265-b42a-49a0-8d57-f9362045cd9b/4728e4be-5a19-43c0-89cf-ced2a190645d/3cb56f58-bc29-4444-8b73-47ccd15779fc) {{(pid=101245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:20:00.743321 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-68174683-87f8-4955-a7ee-d28e628002ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for port, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:00.774571 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-68174683-87f8-4955-a7ee-d28e628002ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:00.809489 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68174683-87f8-4955-a7ee-d28e628002ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Network 68f46265-b42a-49a0-8d57-f9362045cd9b is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:20:00.812044 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-68174683-87f8-4955-a7ee-d28e628002ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:20:00.817215 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68174683-87f8-4955-a7ee-d28e628002ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Received port after_create {{(pid=101245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:20:00.839538 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68174683-87f8-4955-a7ee-d28e628002ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Pushing event updated for resources: {'Port': ['ID=3cb56f58-bc29-4444-8b73-47ccd15779fc,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:20:00.903335 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-68174683-87f8-4955-a7ee-d28e628002ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:00.936056 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-68174683-87f8-4955-a7ee-d28e628002ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:01.081118 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-68174683-87f8-4955-a7ee-d28e628002ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for port, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:01.087122 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-68174683-87f8-4955-a7ee-d28e628002ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7464016'] for port, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:01.114519 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41ffe655-3fca-4afb-ac44-c5843e56d138 req-a4ef63bf-7f2f-40a9-ae2f-212dcf16555e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:01.116225 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-41ffe655-3fca-4afb-ac44-c5843e56d138 req-a4ef63bf-7f2f-40a9-ae2f-212dcf16555e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 984 time: 0.0510733 Nov 08 16:20:01.152155 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68174683-87f8-4955-a7ee-d28e628002ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Pushing event updated for resources: {'Port': ['ID=3cb56f58-bc29-4444-8b73-47ccd15779fc,revision_number=2']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:20:01.163836 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-68174683-87f8-4955-a7ee-d28e628002ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-2032271'] for floatingip, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:01.176796 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-41ffe655-3fca-4afb-ac44-c5843e56d138 req-7a372739-9379-4412-b49d-0d6703bcd969 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&id=1d27de4f-b93c-4054-9b9d-62a7c87a8620&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0528307 Nov 08 16:20:01.178427 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-68174683-87f8-4955-a7ee-d28e628002ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for floatingip, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:01.180148 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-68174683-87f8-4955-a7ee-d28e628002ee tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 0.7515917 Nov 08 16:20:01.370236 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-07347cce-bde2-49ae-8dd2-5ea293f63473 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?name=tempest-securitygroup--1155485669&fields=id&tenant_id=f6e779f0506643d08d984c2971d5a71c HTTP/1.1" status: 200 len: 267 time: 0.0414608 Nov 08 16:20:01.478658 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-7de5889e-84f6-4803-a312-bdb9a5912f0c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:01.480122 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-7de5889e-84f6-4803-a312-bdb9a5912f0c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/networks?id=75fa9c3e-7bfe-490a-9118-221394c29646 HTTP/1.1" status: 200 len: 810 time: 0.1036654 Nov 08 16:20:01.494663 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-3142428a-c845-4c87-9f27-ebe4700554f7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/quotas/f6e779f0506643d08d984c2971d5a71c HTTP/1.1" status: 200 len: 375 time: 0.0090070 Nov 08 16:20:01.548505 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-d95a1ffc-9cee-4d75-b971-650504b2a7ff tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?tenant_id=f6e779f0506643d08d984c2971d5a71c&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0486083 Nov 08 16:20:01.641946 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-48cd17b1-b8ce-47e6-bc3f-83a2311047f4 service neutron] 10.222.0.37 "GET /v2.0/networks/75fa9c3e-7bfe-490a-9118-221394c29646?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0821705 Nov 08 16:20:01.727676 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-13afd048-28f9-4f13-84ef-6af0a4b037c5 service neutron] 10.222.0.37 "GET /v2.0/networks/75fa9c3e-7bfe-490a-9118-221394c29646?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0799344 Nov 08 16:20:01.884611 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-92406b6a-e90e-420a-817b-aadef61326dd req-89a06829-9012-40d4-a378-35ccbc0cf90c tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=0c45dd64-42e8-48a5-8a86-f7ac61c15a2b HTTP/1.1" status: 200 len: 210 time: 0.0267463 Nov 08 16:20:02.299696 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a371788d-877d-4e1d-a9c9-6da8941d36af req-93fe7b88-b306-45b2-b7f6-e292e38b0100 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:02.301175 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a371788d-877d-4e1d-a9c9-6da8941d36af req-93fe7b88-b306-45b2-b7f6-e292e38b0100 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 984 time: 0.0494840 Nov 08 16:20:02.364848 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a371788d-877d-4e1d-a9c9-6da8941d36af req-1be12687-79b6-4ee7-8373-3c0718e76a0b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&id=1d27de4f-b93c-4054-9b9d-62a7c87a8620&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0569429 Nov 08 16:20:02.856560 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-4d270e4d-de63-45c4-aa81-0d92821a95b1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:02.858044 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-4d270e4d-de63-45c4-aa81-0d92821a95b1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.25 "GET /v2.0/networks?id=75fa9c3e-7bfe-490a-9118-221394c29646 HTTP/1.1" status: 200 len: 810 time: 0.0984197 Nov 08 16:20:02.927005 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-e4a75160-42cc-47a3-84ad-caa380cd0abb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.25 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f6e779f0506643d08d984c2971d5a71c HTTP/1.1" status: 200 len: 380 time: 0.0560501 Nov 08 16:20:02.939406 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-c9bc0c46-d410-4633-ba7f-f5a7678fcd58 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Request body: {'port': {'device_id': '0c45dd64-42e8-48a5-8a86-f7ac61c15a2b', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'admin_state_up': True, 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'security_groups': ['d52a633a-858b-44ca-81af-e924516db368']}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:20:03.011970 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6f2ee88c-87f5-448b-afc9-eb7e2721dbb2 req-09c5422b-a9cb-41d3-af76-3772676f1fcb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=0c45dd64-42e8-48a5-8a86-f7ac61c15a2b HTTP/1.1" status: 200 len: 210 time: 0.0579340 Nov 08 16:20:03.069261 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-c9bc0c46-d410-4633-ba7f-f5a7678fcd58 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Made reservation on behalf of f6e779f0506643d08d984c2971d5a71c for: {'port': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:20:03.072752 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-c9bc0c46-d410-4633-ba7f-f5a7678fcd58 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:03.194648 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-c9bc0c46-d410-4633-ba7f-f5a7678fcd58 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Allocated IP 172.20.0.5 (75fa9c3e-7bfe-490a-9118-221394c29646/8b248e51-4c70-4980-9452-c6b625bf96dd/a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:20:03.327824 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-c9bc0c46-d410-4633-ba7f-f5a7678fcd58 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:03.359828 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-c9bc0c46-d410-4633-ba7f-f5a7678fcd58 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:03.400852 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-c9bc0c46-d410-4633-ba7f-f5a7678fcd58 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Network 75fa9c3e-7bfe-490a-9118-221394c29646 is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:20:03.406498 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-c9bc0c46-d410-4633-ba7f-f5a7678fcd58 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:20:03.410264 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-c9bc0c46-d410-4633-ba7f-f5a7678fcd58 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:20:03.434065 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9bc0c46-d410-4633-ba7f-f5a7678fcd58 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Pushing event updated for resources: {'Port': ['ID=a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:20:03.488053 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-c9bc0c46-d410-4633-ba7f-f5a7678fcd58 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:03.488666 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-c9bc0c46-d410-4633-ba7f-f5a7678fcd58 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:03.512931 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cfd9540-a043-46bc-883e-27140eb646fa req-a4920f00-c96b-426a-ae72-1d3a3403e028 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:03.514507 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4cfd9540-a043-46bc-883e-27140eb646fa req-a4920f00-c96b-426a-ae72-1d3a3403e028 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 984 time: 0.0758464 Nov 08 16:20:03.518287 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-c9bc0c46-d410-4633-ba7f-f5a7678fcd58 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5827696 Nov 08 16:20:03.540334 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-0b6cdb4a-61fd-4acb-9bcf-885ea1747d7f service neutron] Request body: {'port': {'device_id': '0c45dd64-42e8-48a5-8a86-f7ac61c15a2b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81618'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:20:03.601145 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-2a414636-4f66-430b-b72a-07b14be70dfc None None] Provisioning complete for port a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:20:03.602281 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-2a414636-4f66-430b-b72a-07b14be70dfc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:03.624449 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-0b6cdb4a-61fd-4acb-9bcf-885ea1747d7f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:03.632281 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4cfd9540-a043-46bc-883e-27140eb646fa req-c8623aed-2017-4f11-a06b-8965d527acf3 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&id=1d27de4f-b93c-4054-9b9d-62a7c87a8620&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1104448 Nov 08 16:20:03.638689 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-2a414636-4f66-430b-b72a-07b14be70dfc None None] Port a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:20:03.882399 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-0b6cdb4a-61fd-4acb-9bcf-885ea1747d7f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 {{(pid=101244) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:20:03.890053 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-0b6cdb4a-61fd-4acb-9bcf-885ea1747d7f service neutron] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:03.901895 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.provisioning_blocks [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-0b6cdb4a-61fd-4acb-9bcf-885ea1747d7f service neutron] Transition to ACTIVE for port object a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 will not be triggered until provisioned by entity L2. {{(pid=101244) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 16:20:03.905475 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-0b6cdb4a-61fd-4acb-9bcf-885ea1747d7f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:03.957292 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b6cdb4a-61fd-4acb-9bcf-885ea1747d7f service neutron] Pushing event updated for resources: {'Port': ['ID=a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00,revision_number=2']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:20:04.025773 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-0b6cdb4a-61fd-4acb-9bcf-885ea1747d7f service neutron] Attempting to bind port a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 on host hv-cinder-81618 for vnic_type normal with profile {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:20:04.026107 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-0b6cdb4a-61fd-4acb-9bcf-885ea1747d7f service neutron] Attempting to bind port a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 by drivers openvswitch,hyperv on host hv-cinder-81618 at level 0 using segments [{'id': '7651dfae-d245-4d32-b379-dc243d043404', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646'}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:20:04.026448 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-0b6cdb4a-61fd-4acb-9bcf-885ea1747d7f service neutron] Attempting to bind port a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 on network 75fa9c3e-7bfe-490a-9118-221394c29646 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:20:04.030848 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-0b6cdb4a-61fd-4acb-9bcf-885ea1747d7f service neutron] Port a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 on network 75fa9c3e-7bfe-490a-9118-221394c29646 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81618 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 16:20:04.031164 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-0b6cdb4a-61fd-4acb-9bcf-885ea1747d7f service neutron] Attempting to bind port a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 on network 75fa9c3e-7bfe-490a-9118-221394c29646 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:20:04.036251 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-0b6cdb4a-61fd-4acb-9bcf-885ea1747d7f service neutron] Checking agent: {'id': '54bf9779-c14d-412a-90fc-96b4a6589d5a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81618', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'started_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 19, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:20:04.036585 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-0b6cdb4a-61fd-4acb-9bcf-885ea1747d7f service neutron] Checking segment: {'id': '7651dfae-d245-4d32-b379-dc243d043404', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:20:04.036963 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-0b6cdb4a-61fd-4acb-9bcf-885ea1747d7f service neutron] Bound using segment: {'id': '7651dfae-d245-4d32-b379-dc243d043404', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646'} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:20:04.037384 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-0b6cdb4a-61fd-4acb-9bcf-885ea1747d7f service neutron] Bound port: a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00, host: hv-cinder-81618, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7651dfae-d245-4d32-b379-dc243d043404', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646'}}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:20:04.037771 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-0b6cdb4a-61fd-4acb-9bcf-885ea1747d7f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:04.130779 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-0b6cdb4a-61fd-4acb-9bcf-885ea1747d7f service neutron] For port a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00, host hv-cinder-81618, cleared binding levels {{(pid=101244) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:20:04.146460 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-0b6cdb4a-61fd-4acb-9bcf-885ea1747d7f service neutron] For port a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00, host hv-cinder-81618, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00,segment=NetworkSegment(7651dfae-d245-4d32-b379-dc243d043404),segment_id=7651dfae-d245-4d32-b379-dc243d043404)] {{(pid=101244) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:20:04.152332 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-0b6cdb4a-61fd-4acb-9bcf-885ea1747d7f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:04.168261 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c71e5059-c0ae-4454-a081-4cdb73441c61 req-f43905d0-6bcc-4865-9a76-75a2d809715f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:04.169789 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c71e5059-c0ae-4454-a081-4cdb73441c61 req-f43905d0-6bcc-4865-9a76-75a2d809715f tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=0c45dd64-42e8-48a5-8a86-f7ac61c15a2b HTTP/1.1" status: 200 len: 943 time: 0.0857353 Nov 08 16:20:04.203672 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-0b6cdb4a-61fd-4acb-9bcf-885ea1747d7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:04.204214 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-0b6cdb4a-61fd-4acb-9bcf-885ea1747d7f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:04.205554 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-0b6cdb4a-61fd-4acb-9bcf-885ea1747d7f service neutron] 10.222.0.25 "PUT /v2.0/ports/a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 HTTP/1.1" status: 200 len: 1093 time: 0.6761847 Nov 08 16:20:04.206018 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0c45dd64-42e8-48a5-8a86-f7ac61c15a2b', 'tag': 'a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:20:04.208221 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5d2894c7-8903-41ac-a7b6-470f316feaab" -d '{"events": [{"name": "network-changed", "server_uuid": "0c45dd64-42e8-48a5-8a86-f7ac61c15a2b", "tag": "a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:20:04.254784 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:20:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f566cfc8-bac6-43f6-8452-a2631cc86831 x-openstack-request-id: req-f566cfc8-bac6-43f6-8452-a2631cc86831 {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:20:04.255076 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0c45dd64-42e8-48a5-8a86-f7ac61c15a2b", "tag": "a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:20:04.255325 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-f566cfc8-bac6-43f6-8452-a2631cc86831 {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:20:04.255720 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0c45dd64-42e8-48a5-8a86-f7ac61c15a2b', 'tag': 'a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00', 'status': 'completed', 'code': 200} Nov 08 16:20:04.256276 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b6cdb4a-61fd-4acb-9bcf-885ea1747d7f service neutron] Pushing event updated for resources: {'Port': ['ID=a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00,revision_number=3']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:20:04.280205 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c71e5059-c0ae-4454-a081-4cdb73441c61 req-ab297e24-785f-430d-a9a4-1f349b837d5a tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=d52a633a-858b-44ca-81af-e924516db368&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0913904 Nov 08 16:20:04.309097 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-9e968d76-790c-46ea-a44e-8a977ff320d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:04.310823 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-9e968d76-790c-46ea-a44e-8a977ff320d6 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=f6e779f0506643d08d984c2971d5a71c&device_id=0c45dd64-42e8-48a5-8a86-f7ac61c15a2b HTTP/1.1" status: 200 len: 1096 time: 0.0471725 Nov 08 16:20:04.358097 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-528fdc39-f31b-4ce3-ba46-8a5c226ca803 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 HTTP/1.1" status: 200 len: 217 time: 0.0386724 Nov 08 16:20:04.407519 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-6c2a5017-ff94-4325-bdcc-ba8878ea616a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:04.408944 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-6c2a5017-ff94-4325-bdcc-ba8878ea616a service neutron] 10.222.0.25 "GET /v2.0/subnets?id=8b248e51-4c70-4980-9452-c6b625bf96dd HTTP/1.1" status: 200 len: 849 time: 0.0442863 Nov 08 16:20:04.454311 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-135a50fa-bdaa-4626-a52d-2c38dce90a07 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:04.455714 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-135a50fa-bdaa-4626-a52d-2c38dce90a07 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=75fa9c3e-7bfe-490a-9118-221394c29646&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0376124 Nov 08 16:20:04.547537 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-f10f7a73-0b8e-4222-968c-b4b7cabededa service neutron] 10.222.0.25 "GET /v2.0/networks/75fa9c3e-7bfe-490a-9118-221394c29646?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0822864 Nov 08 16:20:04.637413 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5cc6baa4-77e2-46b4-b550-aea86aae7162 req-1f0f4cb4-f8d5-4d05-8d0c-6ba9027ca2f1 service neutron] 10.222.0.25 "GET /v2.0/networks/75fa9c3e-7bfe-490a-9118-221394c29646?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0786531 Nov 08 16:20:04.759300 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d2894c7-8903-41ac-a7b6-470f316feaab req-6c87288f-ba36-40eb-80d1-e6e89b3c8ac4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:04.760689 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5d2894c7-8903-41ac-a7b6-470f316feaab req-6c87288f-ba36-40eb-80d1-e6e89b3c8ac4 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=f6e779f0506643d08d984c2971d5a71c&device_id=0c45dd64-42e8-48a5-8a86-f7ac61c15a2b HTTP/1.1" status: 200 len: 1096 time: 0.0729270 Nov 08 16:20:04.774678 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63d706e3-6a76-4f7e-a445-6f06c47b4258 req-472f9c63-fb7b-4436-8de6-9ffdf981f04a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:04.776085 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-63d706e3-6a76-4f7e-a445-6f06c47b4258 req-472f9c63-fb7b-4436-8de6-9ffdf981f04a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 984 time: 0.0640202 Nov 08 16:20:04.893957 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-63d706e3-6a76-4f7e-a445-6f06c47b4258 req-33f07c13-a2b1-4a58-a715-2010a334832e tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&id=1d27de4f-b93c-4054-9b9d-62a7c87a8620&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1091328 Nov 08 16:20:04.902895 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d2894c7-8903-41ac-a7b6-470f316feaab req-b51342e8-2ea7-411e-8bbb-b14f14ac6472 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:04.904288 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5d2894c7-8903-41ac-a7b6-470f316feaab req-b51342e8-2ea7-411e-8bbb-b14f14ac6472 service neutron] 10.222.0.25 "GET /v2.0/networks?id=75fa9c3e-7bfe-490a-9118-221394c29646 HTTP/1.1" status: 200 len: 911 time: 0.1273861 Nov 08 16:20:04.946084 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5d2894c7-8903-41ac-a7b6-470f316feaab req-ed143ccd-4bd8-4cc3-b9ba-673d94d18064 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 HTTP/1.1" status: 200 len: 217 time: 0.0336037 Nov 08 16:20:04.992599 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d2894c7-8903-41ac-a7b6-470f316feaab req-65cdd208-c254-4297-a7e1-47b75effc476 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:04.994254 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5d2894c7-8903-41ac-a7b6-470f316feaab req-65cdd208-c254-4297-a7e1-47b75effc476 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=8b248e51-4c70-4980-9452-c6b625bf96dd HTTP/1.1" status: 200 len: 849 time: 0.0415320 Nov 08 16:20:05.038205 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d2894c7-8903-41ac-a7b6-470f316feaab req-fa5dc596-a745-4dec-a6fe-2c9f8b138021 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:05.039607 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5d2894c7-8903-41ac-a7b6-470f316feaab req-fa5dc596-a745-4dec-a6fe-2c9f8b138021 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=75fa9c3e-7bfe-490a-9118-221394c29646&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0378833 Nov 08 16:20:05.130910 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5d2894c7-8903-41ac-a7b6-470f316feaab req-04e23d2d-e186-4cbb-aae7-d2ea35f6d5da service neutron] 10.222.0.25 "GET /v2.0/networks/75fa9c3e-7bfe-490a-9118-221394c29646?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0832698 Nov 08 16:20:05.219210 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5d2894c7-8903-41ac-a7b6-470f316feaab req-1ee00e30-fb73-43ae-ba95-492823463d9c service neutron] 10.222.0.25 "GET /v2.0/networks/75fa9c3e-7bfe-490a-9118-221394c29646?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0795827 Nov 08 16:20:05.402620 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dc866df-459c-41bd-a355-1cd0f8453f0d req-9b49d5e2-f13e-49fa-8cbb-6f59c08ea504 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:05.404074 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3dc866df-459c-41bd-a355-1cd0f8453f0d req-9b49d5e2-f13e-49fa-8cbb-6f59c08ea504 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=0c45dd64-42e8-48a5-8a86-f7ac61c15a2b HTTP/1.1" status: 200 len: 943 time: 0.0522354 Nov 08 16:20:05.448510 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3dc866df-459c-41bd-a355-1cd0f8453f0d req-0643ab62-cae0-415f-8b6d-600638e962da tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=d52a633a-858b-44ca-81af-e924516db368&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386584 Nov 08 16:20:06.009984 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26983c54-385a-444a-9967-72ba8e750211 req-deb7636b-cb02-43bc-a7a9-a6c85628be86 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:06.011462 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-26983c54-385a-444a-9967-72ba8e750211 req-deb7636b-cb02-43bc-a7a9-a6c85628be86 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 984 time: 0.0485523 Nov 08 16:20:06.069280 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-26983c54-385a-444a-9967-72ba8e750211 req-43deeb52-a538-484e-8878-32edb95a883b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&id=1d27de4f-b93c-4054-9b9d-62a7c87a8620&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0519221 Nov 08 16:20:06.561523 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aac2b7b-cd7a-4413-bd85-9e3442a0ccb1 req-ca76cc50-6860-4660-87cb-5067c502ceec tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:06.563130 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6aac2b7b-cd7a-4413-bd85-9e3442a0ccb1 req-ca76cc50-6860-4660-87cb-5067c502ceec tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=0c45dd64-42e8-48a5-8a86-f7ac61c15a2b HTTP/1.1" status: 200 len: 943 time: 0.0478258 Nov 08 16:20:06.612092 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6aac2b7b-cd7a-4413-bd85-9e3442a0ccb1 req-96fd0f4a-ff5c-4b91-ae74-9dd924f2bd19 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=d52a633a-858b-44ca-81af-e924516db368&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429666 Nov 08 16:20:07.185628 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e78755da-a4f7-4aba-8415-432ca8b666de req-ac375e40-f5f1-4ae9-a023-939796331448 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:07.187090 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e78755da-a4f7-4aba-8415-432ca8b666de req-ac375e40-f5f1-4ae9-a023-939796331448 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 984 time: 0.0482595 Nov 08 16:20:07.244631 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e78755da-a4f7-4aba-8415-432ca8b666de req-a054a8a7-b109-4381-b3cb-8396e67692b5 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&id=1d27de4f-b93c-4054-9b9d-62a7c87a8620&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0517666 Nov 08 16:20:07.732079 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7e7f7ee-936d-41c1-8456-b82325337858 req-8380eae4-b437-4d5f-8eaf-e746c5788ce6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:07.733616 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d7e7f7ee-936d-41c1-8456-b82325337858 req-8380eae4-b437-4d5f-8eaf-e746c5788ce6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=0c45dd64-42e8-48a5-8a86-f7ac61c15a2b HTTP/1.1" status: 200 len: 943 time: 0.0520175 Nov 08 16:20:07.780556 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d7e7f7ee-936d-41c1-8456-b82325337858 req-00bf913b-55fe-4daa-aa65-095888a010b7 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=d52a633a-858b-44ca-81af-e924516db368&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410795 Nov 08 16:20:08.125178 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ca46c60e-78ea-4277-a05f-0887f93bf6e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:08.449523 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:20:08.539416 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00,segment=NetworkSegment(7651dfae-d245-4d32-b379-dc243d043404),segment_id=7651dfae-d245-4d32-b379-dc243d043404)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:20:08.553119 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': 'a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'port_id': 'a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00', 'mac_address': 'fa:16:3e:99:22:77', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 191, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:20:08.588240 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:08.600827 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:20:08.619329 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00,segment=NetworkSegment(7651dfae-d245-4d32-b379-dc243d043404),segment_id=7651dfae-d245-4d32-b379-dc243d043404)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:20:08.624119 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:08.669816 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:20:08.897789 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-292e702b-c216-4c95-9a78-b2e1db0c7a62 req-10f1a23a-a391-442d-a74a-84f0e3da7fc1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:08.899265 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-292e702b-c216-4c95-9a78-b2e1db0c7a62 req-10f1a23a-a391-442d-a74a-84f0e3da7fc1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=0c45dd64-42e8-48a5-8a86-f7ac61c15a2b HTTP/1.1" status: 200 len: 944 time: 0.0529904 Nov 08 16:20:08.944526 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-292e702b-c216-4c95-9a78-b2e1db0c7a62 req-ddf5cd2e-2d5a-4918-b19f-63a8fe7899eb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=d52a633a-858b-44ca-81af-e924516db368&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393531 Nov 08 16:20:09.010167 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:20:10.056308 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6599ded-6d90-4a51-84e0-40e12336b3b9 req-84a0027a-ef70-408b-8906-e8e70412f70e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:10.057774 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c6599ded-6d90-4a51-84e0-40e12336b3b9 req-84a0027a-ef70-408b-8906-e8e70412f70e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=0c45dd64-42e8-48a5-8a86-f7ac61c15a2b HTTP/1.1" status: 200 len: 944 time: 0.0482123 Nov 08 16:20:10.103172 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c6599ded-6d90-4a51-84e0-40e12336b3b9 req-d48ff4ec-17fe-40a2-87a0-a1b767a0c106 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=d52a633a-858b-44ca-81af-e924516db368&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395665 Nov 08 16:20:10.465149 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:20:10.511789 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning for port a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 completed by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 16:20:10.515579 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:20:10.515944 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:10.602393 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-3d01b0ec-6b7c-4ffa-ac2c-28c73f0089eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:10.605888 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:10.628057 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0c45dd64-42e8-48a5-8a86-f7ac61c15a2b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:20:10.630323 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5c65c1eb-fcf7-4c4d-ad3f-af87e799c34a" -d '{"events": [{"server_uuid": "0c45dd64-42e8-48a5-8a86-f7ac61c15a2b", "name": "network-vif-plugged", "status": "completed", "tag": "a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:20:10.643310 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00,segment=NetworkSegment(7651dfae-d245-4d32-b379-dc243d043404),segment_id=7651dfae-d245-4d32-b379-dc243d043404)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:20:10.647202 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:10.671599 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:20:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5ff2c60a-4a4f-47d3-9c3d-d602ff8d47c5 x-openstack-request-id: req-5ff2c60a-4a4f-47d3-9c3d-d602ff8d47c5 {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:20:10.671886 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0c45dd64-42e8-48a5-8a86-f7ac61c15a2b", "name": "network-vif-plugged", "status": "completed", "tag": "a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:20:10.672138 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-5ff2c60a-4a4f-47d3-9c3d-d602ff8d47c5 {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:20:10.672525 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0c45dd64-42e8-48a5-8a86-f7ac61c15a2b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00', 'code': 200} Nov 08 16:20:10.697732 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:20:10.826276 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9eb6e2f-af30-4530-838d-e6091358ffb6 req-69b51654-a8b1-4277-9d43-2bbc1b202d3f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:10.827628 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d9eb6e2f-af30-4530-838d-e6091358ffb6 req-69b51654-a8b1-4277-9d43-2bbc1b202d3f service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=0c45dd64-42e8-48a5-8a86-f7ac61c15a2b HTTP/1.1" status: 200 len: 1098 time: 0.0405324 Nov 08 16:20:10.872136 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d9eb6e2f-af30-4530-838d-e6091358ffb6 req-4cf7590a-a8cb-411c-845b-57629d11b8fb service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=d52a633a-858b-44ca-81af-e924516db368&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0365543 Nov 08 16:20:11.222156 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c6f2cd6-678f-4832-ad81-97b3cd4eb361 req-e18b9639-ed2d-400f-9544-5c9c20297059 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:11.223621 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7c6f2cd6-678f-4832-ad81-97b3cd4eb361 req-e18b9639-ed2d-400f-9544-5c9c20297059 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=0c45dd64-42e8-48a5-8a86-f7ac61c15a2b HTTP/1.1" status: 200 len: 945 time: 0.0512755 Nov 08 16:20:11.268970 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7c6f2cd6-678f-4832-ad81-97b3cd4eb361 req-d81b3e19-efde-49a0-95b3-91199fb30feb tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=d52a633a-858b-44ca-81af-e924516db368&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394700 Nov 08 16:20:11.545380 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:12.385598 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2985fa3-8a6b-47ad-89f2-a9d3aea98355 req-39d20496-df8c-48b9-bf7f-0fc50f2dd516 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:12.387206 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e2985fa3-8a6b-47ad-89f2-a9d3aea98355 req-39d20496-df8c-48b9-bf7f-0fc50f2dd516 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=0c45dd64-42e8-48a5-8a86-f7ac61c15a2b HTTP/1.1" status: 200 len: 945 time: 0.0485876 Nov 08 16:20:12.436213 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e2985fa3-8a6b-47ad-89f2-a9d3aea98355 req-4786adad-774c-4573-9bb4-76a84d398f5e tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=d52a633a-858b-44ca-81af-e924516db368&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427225 Nov 08 16:20:13.279425 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:13.548319 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df499543-3b85-439e-adb1-79eb15ccf287 req-38a3549d-bdb3-4a64-b927-655aa961ffc3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:13.549802 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-df499543-3b85-439e-adb1-79eb15ccf287 req-38a3549d-bdb3-4a64-b927-655aa961ffc3 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=0c45dd64-42e8-48a5-8a86-f7ac61c15a2b HTTP/1.1" status: 200 len: 945 time: 0.0476470 Nov 08 16:20:13.595034 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-df499543-3b85-439e-adb1-79eb15ccf287 req-ce71b6a8-840f-4986-801d-6814f4e5c135 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=d52a633a-858b-44ca-81af-e924516db368&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395236 Nov 08 16:20:13.704028 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84a8e765-5a34-4182-9332-ed21726f096b req-68ee10d3-b83f-45a7-8a24-2aac97bd9fca tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:13.705466 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-84a8e765-5a34-4182-9332-ed21726f096b req-68ee10d3-b83f-45a7-8a24-2aac97bd9fca tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=0c45dd64-42e8-48a5-8a86-f7ac61c15a2b HTTP/1.1" status: 200 len: 945 time: 0.0468354 Nov 08 16:20:13.713668 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 41168) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:20:13.717868 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-982b1c1d-54d1-4c16-b384-8fc63795ef91 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Request body: {'floatingip': {'port_id': 'a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:20:13.758213 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-982b1c1d-54d1-4c16-b384-8fc63795ef91 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for floatingip, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:13.963427 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:14.178878 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-982b1c1d-54d1-4c16-b384-8fc63795ef91 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:14.183008 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-982b1c1d-54d1-4c16-b384-8fc63795ef91 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-2032271'] for floatingip, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:14.277562 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.db.l3_db [None req-982b1c1d-54d1-4c16-b384-8fc63795ef91 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Floating IP 7c719750-67be-4039-9016-b5c078c41258 associated. External IP: 172.27.3.195, port: a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00. Nov 08 16:20:14.696051 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-982b1c1d-54d1-4c16-b384-8fc63795ef91 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Router c3f55c44-bed1-4955-9229-dac3c412f010 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:20:14.798944 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-982b1c1d-54d1-4c16-b384-8fc63795ef91 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:20:14.803791 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-982b1c1d-54d1-4c16-b384-8fc63795ef91 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for floatingip, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:14.808793 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9fe767fb-e89a-40f4-b7e0-5dd9a0a84087 None None] Sync routers for ids ['c3f55c44-bed1-4955-9229-dac3c412f010'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:20:14.818220 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9fe767fb-e89a-40f4-b7e0-5dd9a0a84087 None None] Routers {'c3f55c44-bed1-4955-9229-dac3c412f010'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:20:14.818830 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-9fe767fb-e89a-40f4-b7e0-5dd9a0a84087 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:20:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['c3f55c44-bed1-4955-9229-dac3c412f010'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:20:14.829788 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-982b1c1d-54d1-4c16-b384-8fc63795ef91 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "PUT /v2.0/floatingips/7c719750-67be-4039-9016-b5c078c41258 HTTP/1.1" status: 200 len: 991 time: 1.1150727 Nov 08 16:20:14.830456 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0c45dd64-42e8-48a5-8a86-f7ac61c15a2b', 'tag': 'a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:20:14.832775 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0f6639f5-cd1c-4f83-972d-f8017fcec193" -d '{"events": [{"name": "network-changed", "server_uuid": "0c45dd64-42e8-48a5-8a86-f7ac61c15a2b", "tag": "a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:20:14.877193 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:20:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bc80dbca-f773-46ac-b58d-708ea3a21265 x-openstack-request-id: req-bc80dbca-f773-46ac-b58d-708ea3a21265 {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:20:14.877486 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0c45dd64-42e8-48a5-8a86-f7ac61c15a2b", "tag": "a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:20:14.877756 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-bc80dbca-f773-46ac-b58d-708ea3a21265 {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:20:14.878158 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0c45dd64-42e8-48a5-8a86-f7ac61c15a2b', 'tag': 'a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00', 'status': 'completed', 'code': 200} Nov 08 16:20:14.927896 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-9fe767fb-e89a-40f4-b7e0-5dd9a0a84087 None None] Set router c3f55c44-bed1-4955-9229-dac3c412f010 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:20:14.945356 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f6639f5-cd1c-4f83-972d-f8017fcec193 req-d3c5ef8d-afaf-4ed4-a858-03f13d0b6ed1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:14.947180 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0f6639f5-cd1c-4f83-972d-f8017fcec193 req-d3c5ef8d-afaf-4ed4-a858-03f13d0b6ed1 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=f6e779f0506643d08d984c2971d5a71c&device_id=0c45dd64-42e8-48a5-8a86-f7ac61c15a2b HTTP/1.1" status: 200 len: 1098 time: 0.0425279 Nov 08 16:20:15.041992 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f6639f5-cd1c-4f83-972d-f8017fcec193 req-60e4c861-e255-4579-8882-b79763bdb524 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:15.043480 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0f6639f5-cd1c-4f83-972d-f8017fcec193 req-60e4c861-e255-4579-8882-b79763bdb524 service neutron] 10.222.0.25 "GET /v2.0/networks?id=75fa9c3e-7bfe-490a-9118-221394c29646 HTTP/1.1" status: 200 len: 911 time: 0.0890684 Nov 08 16:20:15.110394 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0f6639f5-cd1c-4f83-972d-f8017fcec193 req-ceba0223-d145-4f74-8f72-cf9b31d54f17 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 HTTP/1.1" status: 200 len: 999 time: 0.0590270 Nov 08 16:20:15.148792 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-9fe767fb-e89a-40f4-b7e0-5dd9a0a84087 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'name': 'tempest-AttachVolumeTestJSON-272347721-router', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128'}], 'enable_snat': True}, 'gw_port_id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 4, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'gw_port': {'id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:97:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': '7c719750-67be-4039-9016-b5c078c41258', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'floating_ip_address': '172.27.3.195', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'port_id': 'a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 551, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'mac_address': 'fa:16:3e:99:22:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c45dd64-42e8-48a5-8a86-f7ac61c15a2b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:20:00Z', 'updated_at': '2021-11-08T16:20:14Z', 'revision_number': 1, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '30759480-5159-4b6e-a269-86ac7d105870', 'name': '', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'mac_address': 'fa:16:3e:86:ee:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:13Z', 'updated_at': '2021-11-08T16:11:28Z', 'revision_number': 5, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'subnets': [{'id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:20:15.163927 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f6639f5-cd1c-4f83-972d-f8017fcec193 req-5ef3b7cd-3eac-4950-bab9-f83bd507abac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:15.165364 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0f6639f5-cd1c-4f83-972d-f8017fcec193 req-5ef3b7cd-3eac-4950-bab9-f83bd507abac service neutron] 10.222.0.25 "GET /v2.0/subnets?id=8b248e51-4c70-4980-9452-c6b625bf96dd HTTP/1.1" status: 200 len: 849 time: 0.0463796 Nov 08 16:20:15.178397 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9fe767fb-e89a-40f4-b7e0-5dd9a0a84087 None None] Checking router: c3f55c44-bed1-4955-9229-dac3c412f010 for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:20:15.187245 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9fe767fb-e89a-40f4-b7e0-5dd9a0a84087 None None] Routers {'c3f55c44-bed1-4955-9229-dac3c412f010'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:20:15.187845 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-9fe767fb-e89a-40f4-b7e0-5dd9a0a84087 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:20:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['c3f55c44-bed1-4955-9229-dac3c412f010'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:20:15.209299 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f6639f5-cd1c-4f83-972d-f8017fcec193 req-9f0cf319-2f27-4ef6-960a-2e96e8f4981d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:15.210730 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0f6639f5-cd1c-4f83-972d-f8017fcec193 req-9f0cf319-2f27-4ef6-960a-2e96e8f4981d service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=75fa9c3e-7bfe-490a-9118-221394c29646&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0384085 Nov 08 16:20:15.286442 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-9fe767fb-e89a-40f4-b7e0-5dd9a0a84087 None None] Set router c3f55c44-bed1-4955-9229-dac3c412f010 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:20:15.296276 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0f6639f5-cd1c-4f83-972d-f8017fcec193 req-f742ae11-1aa1-4c29-835d-b88ddb69976d service neutron] 10.222.0.25 "GET /v2.0/networks/75fa9c3e-7bfe-490a-9118-221394c29646?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0781577 Nov 08 16:20:15.388670 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0f6639f5-cd1c-4f83-972d-f8017fcec193 req-d1eb4d77-9de3-4100-a9dc-b7ca18ee26a7 service neutron] 10.222.0.25 "GET /v2.0/networks/75fa9c3e-7bfe-490a-9118-221394c29646?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0848234 Nov 08 16:20:15.504681 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-9fe767fb-e89a-40f4-b7e0-5dd9a0a84087 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'name': 'tempest-AttachVolumeTestJSON-272347721-router', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128'}], 'enable_snat': True}, 'gw_port_id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 4, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'gw_port': {'id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:97:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': '7c719750-67be-4039-9016-b5c078c41258', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'floating_ip_address': '172.27.3.195', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'port_id': 'a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 551, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'mac_address': 'fa:16:3e:99:22:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c45dd64-42e8-48a5-8a86-f7ac61c15a2b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:20:00Z', 'updated_at': '2021-11-08T16:20:14Z', 'revision_number': 1, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '30759480-5159-4b6e-a269-86ac7d105870', 'name': '', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'mac_address': 'fa:16:3e:86:ee:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:13Z', 'updated_at': '2021-11-08T16:11:28Z', 'revision_number': 5, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'subnets': [{'id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:20:15.530510 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9fe767fb-e89a-40f4-b7e0-5dd9a0a84087 None None] The sync data for ids ['c3f55c44-bed1-4955-9229-dac3c412f010'] in dv-cinder-816187-2-iscsi is: [{'id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'name': 'tempest-AttachVolumeTestJSON-272347721-router', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128'}], 'enable_snat': True}, 'gw_port_id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 4, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'gw_port': {'id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:97:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': '7c719750-67be-4039-9016-b5c078c41258', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'floating_ip_address': '172.27.3.195', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'port_id': 'a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 551, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'mac_address': 'fa:16:3e:99:22:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c45dd64-42e8-48a5-8a86-f7ac61c15a2b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:20:00Z', 'updated_at': '2021-11-08T16:20:14Z', 'revision_number': 1, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '30759480-5159-4b6e-a269-86ac7d105870', 'name': '', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'mac_address': 'fa:16:3e:86:ee:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:13Z', 'updated_at': '2021-11-08T16:11:28Z', 'revision_number': 5, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'subnets': [{'id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:20:15.703984 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f80a8923-b581-4b1a-a7e2-af301b5df8f5 None None] New status for floating IP 7c719750-67be-4039-9016-b5c078c41258: ACTIVE {{(pid=101247) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 16:20:17.971000 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:19.289453 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9e476995-c8d9-442d-8f58-63a676302710 req-ca94449e-9085-4f76-b98e-5a5ef4cf42d4 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0406516 Nov 08 16:20:19.371471 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e476995-c8d9-442d-8f58-63a676302710 req-0f8b528e-9355-446e-beb4-2b86f67cb740 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:19.373916 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9e476995-c8d9-442d-8f58-63a676302710 req-0f8b528e-9355-446e-beb4-2b86f67cb740 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=9ad6e5c060034b2ca263bfdcb07fe807&device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 1137 time: 0.0397463 Nov 08 16:20:19.480136 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e476995-c8d9-442d-8f58-63a676302710 req-1eaea0f4-06e0-4a8b-94bf-cba91c75e9a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:19.481559 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9e476995-c8d9-442d-8f58-63a676302710 req-1eaea0f4-06e0-4a8b-94bf-cba91c75e9a3 service neutron] 10.222.0.25 "GET /v2.0/networks?id=52eb1d65-dc7c-45c5-9521-97cb18715837 HTTP/1.1" status: 200 len: 915 time: 0.0858977 Nov 08 16:20:19.547837 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9e476995-c8d9-442d-8f58-63a676302710 req-6417948e-a4b9-4a17-a7f4-475c46a0a994 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=304e385a-c4e3-48f0-8723-230b5da69dc3 HTTP/1.1" status: 200 len: 1001 time: 0.0566761 Nov 08 16:20:19.605130 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e476995-c8d9-442d-8f58-63a676302710 req-cab19cc7-d64d-4028-a999-ba626d31ff21 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:19.606525 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9e476995-c8d9-442d-8f58-63a676302710 req-cab19cc7-d64d-4028-a999-ba626d31ff21 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=12999abd-2828-4905-aed0-938c2f27aed8 HTTP/1.1" status: 200 len: 853 time: 0.0452969 Nov 08 16:20:19.661257 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e476995-c8d9-442d-8f58-63a676302710 req-4dc6751c-5263-4a8a-803b-c2ec450ec4c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:20:19.662668 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9e476995-c8d9-442d-8f58-63a676302710 req-4dc6751c-5263-4a8a-803b-c2ec450ec4c9 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=52eb1d65-dc7c-45c5-9521-97cb18715837&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0389149 Nov 08 16:20:19.749124 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9e476995-c8d9-442d-8f58-63a676302710 req-aecf9281-16db-494e-b6cd-ebac33f341d5 service neutron] 10.222.0.25 "GET /v2.0/networks/52eb1d65-dc7c-45c5-9521-97cb18715837?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0787678 Nov 08 16:20:19.839650 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9e476995-c8d9-442d-8f58-63a676302710 req-0e48854e-780f-4b2b-9cf8-f06d4b07a853 service neutron] 10.222.0.25 "GET /v2.0/networks/52eb1d65-dc7c-45c5-9521-97cb18715837?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0826583 Nov 08 16:20:33.600657 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:20:38.125388 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-692e48d0-3dc2-4229-9a36-5ac67e3773c6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:40.592902 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-36fd5dc9-fab1-4043-803b-4c0ecbdf6da3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:41.548626 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:43.281914 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:43.965382 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:20:47.969378 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:06.040800 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-40bb69ae-ad44-41dc-9e38-12c68ce0d787 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-706634952&fields=id&tenant_id=343d5ca096394f87bea0950aa3811a13 HTTP/1.1" status: 200 len: 267 time: 0.0430150 Nov 08 16:21:06.146534 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-212f7c1d-a605-4f18-abd7-b662f0d1f290 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:06.147972 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-212f7c1d-a605-4f18-abd7-b662f0d1f290 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/networks?id=a15e051b-c130-4140-aaf2-a45ea7af5b43 HTTP/1.1" status: 200 len: 812 time: 0.1002874 Nov 08 16:21:06.162727 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-32a73340-1668-4c80-8a8c-315e338b5d16 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/quotas/343d5ca096394f87bea0950aa3811a13 HTTP/1.1" status: 200 len: 375 time: 0.0091779 Nov 08 16:21:06.217447 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-9f467a12-f172-46f4-917c-1f7900d2551b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?tenant_id=343d5ca096394f87bea0950aa3811a13&fields=id HTTP/1.1" status: 200 len: 440 time: 0.0497093 Nov 08 16:21:06.352975 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-8c3411fc-c8fc-4f85-8c47-e4bc9a9b656a service neutron] 10.222.0.37 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1240306 Nov 08 16:21:06.442269 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-c8137530-8ca7-48b0-b12f-a9b46f9c3c7b service neutron] 10.222.0.37 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0834043 Nov 08 16:21:07.736484 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c8649b46-57f9-45e9-8445-8b10a0abe097 req-12536115-8642-498b-9560-da5ad9ab6bdc tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 210 time: 0.0263114 Nov 08 16:21:08.133211 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-116947c1-3c6c-48b1-88ed-a5c7fbc53282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:08.682049 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-f4223828-9ab9-4011-a617-df6d8bc123b6 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:08.683600 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-f4223828-9ab9-4011-a617-df6d8bc123b6 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.25 "GET /v2.0/networks?id=a15e051b-c130-4140-aaf2-a45ea7af5b43 HTTP/1.1" status: 200 len: 812 time: 0.1046991 Nov 08 16:21:08.762417 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-2f17a0d7-99ce-4f0d-bd90-7f654454149e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.25 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=343d5ca096394f87bea0950aa3811a13 HTTP/1.1" status: 200 len: 379 time: 0.0649326 Nov 08 16:21:08.773872 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Request body: {'port': {'device_id': 'f664b3dd-4458-4525-926a-1321ff188fdc', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'admin_state_up': True, 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'security_groups': ['a52bd5f6-4026-4f07-a3d9-c70ec9af4076']}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:21:08.843983 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e1d7d772-93dc-4e27-9221-790bce7f924b req-1cfd70a6-612a-4f8d-a6aa-970a08431342 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 210 time: 0.0312715 Nov 08 16:21:08.905182 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Made reservation on behalf of 343d5ca096394f87bea0950aa3811a13 for: {'port': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:21:08.908594 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:09.027289 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Allocated IP 172.20.0.6 (a15e051b-c130-4140-aaf2-a45ea7af5b43/6e4d65b1-4f2c-453a-847c-970dff985732/ac61ca49-2eb1-4040-99b3-1fc5285b703f) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:21:09.171110 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:09.204933 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:09.252402 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Network a15e051b-c130-4140-aaf2-a45ea7af5b43 is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:21:09.257580 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:21:09.260027 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:21:09.288272 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Pushing event updated for resources: {'Port': ['ID=ac61ca49-2eb1-4040-99b3-1fc5285b703f,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:09.302715 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:09.303060 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:09.303404 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:09.303737 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:09.304073 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:09.304393 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:09.304718 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:09.305041 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:09.305366 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:09.305683 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:09.306024 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:09.306343 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:09.328915 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:09.329528 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:09.346150 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-0a1100c1-ac81-4149-8031-33761a7a55ec tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5765347 Nov 08 16:21:09.371418 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-253626bb-a67f-43b7-a603-6b9b59510668 service neutron] Request body: {'port': {'device_id': 'f664b3dd-4458-4525-926a-1321ff188fdc', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81618'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:21:09.427919 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-253626bb-a67f-43b7-a603-6b9b59510668 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:09.473436 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-9955d03e-d30b-407c-9b51-cc20224e9632 None None] Provisioning complete for port ac61ca49-2eb1-4040-99b3-1fc5285b703f triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:21:09.474068 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-9955d03e-d30b-407c-9b51-cc20224e9632 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:09.510744 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-9955d03e-d30b-407c-9b51-cc20224e9632 None None] Port ac61ca49-2eb1-4040-99b3-1fc5285b703f cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:21:09.672268 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-253626bb-a67f-43b7-a603-6b9b59510668 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ac61ca49-2eb1-4040-99b3-1fc5285b703f {{(pid=101244) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:21:09.679945 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-253626bb-a67f-43b7-a603-6b9b59510668 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:09.691055 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.provisioning_blocks [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-253626bb-a67f-43b7-a603-6b9b59510668 service neutron] Transition to ACTIVE for port object ac61ca49-2eb1-4040-99b3-1fc5285b703f will not be triggered until provisioned by entity L2. {{(pid=101244) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 16:21:09.695153 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-253626bb-a67f-43b7-a603-6b9b59510668 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:09.742396 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-253626bb-a67f-43b7-a603-6b9b59510668 service neutron] Pushing event updated for resources: {'Port': ['ID=ac61ca49-2eb1-4040-99b3-1fc5285b703f,revision_number=2']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:09.819943 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-253626bb-a67f-43b7-a603-6b9b59510668 service neutron] Attempting to bind port ac61ca49-2eb1-4040-99b3-1fc5285b703f on host hv-cinder-81618 for vnic_type normal with profile {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:21:09.820619 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-253626bb-a67f-43b7-a603-6b9b59510668 service neutron] Attempting to bind port ac61ca49-2eb1-4040-99b3-1fc5285b703f by drivers openvswitch,hyperv on host hv-cinder-81618 at level 0 using segments [{'id': '1383b9f8-d178-4a90-828c-184fa1886253', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43'}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:21:09.820619 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-253626bb-a67f-43b7-a603-6b9b59510668 service neutron] Attempting to bind port ac61ca49-2eb1-4040-99b3-1fc5285b703f on network a15e051b-c130-4140-aaf2-a45ea7af5b43 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:21:09.825007 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-253626bb-a67f-43b7-a603-6b9b59510668 service neutron] Port ac61ca49-2eb1-4040-99b3-1fc5285b703f on network a15e051b-c130-4140-aaf2-a45ea7af5b43 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81618 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 16:21:09.825331 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-253626bb-a67f-43b7-a603-6b9b59510668 service neutron] Attempting to bind port ac61ca49-2eb1-4040-99b3-1fc5285b703f on network a15e051b-c130-4140-aaf2-a45ea7af5b43 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:21:09.830341 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-253626bb-a67f-43b7-a603-6b9b59510668 service neutron] Checking agent: {'id': '54bf9779-c14d-412a-90fc-96b4a6589d5a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81618', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'started_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 20, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:21:09.830680 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-253626bb-a67f-43b7-a603-6b9b59510668 service neutron] Checking segment: {'id': '1383b9f8-d178-4a90-828c-184fa1886253', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:21:09.831062 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-253626bb-a67f-43b7-a603-6b9b59510668 service neutron] Bound using segment: {'id': '1383b9f8-d178-4a90-828c-184fa1886253', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43'} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:21:09.831486 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-253626bb-a67f-43b7-a603-6b9b59510668 service neutron] Bound port: ac61ca49-2eb1-4040-99b3-1fc5285b703f, host: hv-cinder-81618, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1383b9f8-d178-4a90-828c-184fa1886253', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43'}}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:21:09.831841 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-253626bb-a67f-43b7-a603-6b9b59510668 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:09.899221 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-253626bb-a67f-43b7-a603-6b9b59510668 service neutron] For port ac61ca49-2eb1-4040-99b3-1fc5285b703f, host hv-cinder-81618, cleared binding levels {{(pid=101244) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:21:09.903320 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-253626bb-a67f-43b7-a603-6b9b59510668 service neutron] For port ac61ca49-2eb1-4040-99b3-1fc5285b703f, host hv-cinder-81618, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=ac61ca49-2eb1-4040-99b3-1fc5285b703f,segment=NetworkSegment(1383b9f8-d178-4a90-828c-184fa1886253),segment_id=1383b9f8-d178-4a90-828c-184fa1886253)] {{(pid=101244) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:21:09.908109 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-253626bb-a67f-43b7-a603-6b9b59510668 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:09.959934 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-253626bb-a67f-43b7-a603-6b9b59510668 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:09.960875 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-253626bb-a67f-43b7-a603-6b9b59510668 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:09.962320 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-253626bb-a67f-43b7-a603-6b9b59510668 service neutron] 10.222.0.25 "PUT /v2.0/ports/ac61ca49-2eb1-4040-99b3-1fc5285b703f HTTP/1.1" status: 200 len: 1093 time: 0.5954833 Nov 08 16:21:09.980640 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f664b3dd-4458-4525-926a-1321ff188fdc', 'tag': 'ac61ca49-2eb1-4040-99b3-1fc5285b703f'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:21:09.984057 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c5f6b534-2270-42a7-a40b-217536f35449" -d '{"events": [{"name": "network-changed", "server_uuid": "f664b3dd-4458-4525-926a-1321ff188fdc", "tag": "ac61ca49-2eb1-4040-99b3-1fc5285b703f"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:21:10.013983 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-253626bb-a67f-43b7-a603-6b9b59510668 service neutron] Pushing event updated for resources: {'Port': ['ID=ac61ca49-2eb1-4040-99b3-1fc5285b703f,revision_number=3']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:10.058945 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f9d6ba-c014-4bae-a22d-50b012553aa4 req-8dcdc6a3-e6a5-4b1b-aa55-08f1d2f3a3cb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:10.060541 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b8f9d6ba-c014-4bae-a22d-50b012553aa4 req-8dcdc6a3-e6a5-4b1b-aa55-08f1d2f3a3cb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 943 time: 0.1257629 Nov 08 16:21:10.064487 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:21:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f950650e-26c8-4048-9794-ea7ec71f8956 x-openstack-request-id: req-f950650e-26c8-4048-9794-ea7ec71f8956 {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:21:10.064776 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f664b3dd-4458-4525-926a-1321ff188fdc", "tag": "ac61ca49-2eb1-4040-99b3-1fc5285b703f", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:21:10.065027 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-f950650e-26c8-4048-9794-ea7ec71f8956 {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:21:10.065419 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f664b3dd-4458-4525-926a-1321ff188fdc', 'tag': 'ac61ca49-2eb1-4040-99b3-1fc5285b703f', 'status': 'completed', 'code': 200} Nov 08 16:21:10.097221 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-c37348ce-5ae0-4cef-bafd-5075ec88b8a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:10.099327 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-c37348ce-5ae0-4cef-bafd-5075ec88b8a9 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=343d5ca096394f87bea0950aa3811a13&device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 1096 time: 0.0774593 Nov 08 16:21:10.154916 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-a95cfcd2-668e-4090-8496-1289a3c02786 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=ac61ca49-2eb1-4040-99b3-1fc5285b703f HTTP/1.1" status: 200 len: 217 time: 0.0473440 Nov 08 16:21:10.160102 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b8f9d6ba-c014-4bae-a22d-50b012553aa4 req-6b72b2fd-d5cb-4977-a543-e22567ebde08 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0915222 Nov 08 16:21:10.206043 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-68af374a-10cc-409c-85c6-da76ee321c6d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:10.208031 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-68af374a-10cc-409c-85c6-da76ee321c6d service neutron] 10.222.0.25 "GET /v2.0/subnets?id=6e4d65b1-4f2c-453a-847c-970dff985732 HTTP/1.1" status: 200 len: 851 time: 0.0441036 Nov 08 16:21:10.253971 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-3c10bade-6961-4071-9ec7-3693e8653c18 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:10.256022 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-3c10bade-6961-4071-9ec7-3693e8653c18 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=a15e051b-c130-4140-aaf2-a45ea7af5b43&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0399120 Nov 08 16:21:10.348556 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-8a3f34c1-9333-4bbd-b7ea-ef7857bc251f service neutron] 10.222.0.25 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842652 Nov 08 16:21:10.436468 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cdca2f51-6595-4224-9fb3-a0dcc10fb656 req-9ed8500a-88cc-4d6c-8959-a6bf08e13902 service neutron] 10.222.0.25 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0806012 Nov 08 16:21:10.532802 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5f6b534-2270-42a7-a40b-217536f35449 req-9c7c33bd-a966-4acd-b7ee-909d91885756 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:10.534287 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c5f6b534-2270-42a7-a40b-217536f35449 req-9c7c33bd-a966-4acd-b7ee-909d91885756 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=343d5ca096394f87bea0950aa3811a13&device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 1096 time: 0.0383902 Nov 08 16:21:10.594376 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-575f7009-18b3-472f-8a68-64fb959a8cc5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:10.599814 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:21:10.627628 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5f6b534-2270-42a7-a40b-217536f35449 req-cda16b45-5378-49a0-80cc-60f20e525ef9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:10.629598 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c5f6b534-2270-42a7-a40b-217536f35449 req-cda16b45-5378-49a0-80cc-60f20e525ef9 service neutron] 10.222.0.25 "GET /v2.0/networks?id=a15e051b-c130-4140-aaf2-a45ea7af5b43 HTTP/1.1" status: 200 len: 913 time: 0.0870810 Nov 08 16:21:10.670868 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c5f6b534-2270-42a7-a40b-217536f35449 req-860b0b0f-2f3c-4c8f-83f0-2bdf67ad752a service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=ac61ca49-2eb1-4040-99b3-1fc5285b703f HTTP/1.1" status: 200 len: 217 time: 0.0333610 Nov 08 16:21:10.725641 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5f6b534-2270-42a7-a40b-217536f35449 req-b978a407-8399-45dc-ae65-a3ab63dc669d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:10.727080 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c5f6b534-2270-42a7-a40b-217536f35449 req-b978a407-8399-45dc-ae65-a3ab63dc669d service neutron] 10.222.0.25 "GET /v2.0/subnets?id=6e4d65b1-4f2c-453a-847c-970dff985732 HTTP/1.1" status: 200 len: 851 time: 0.0450811 Nov 08 16:21:10.778341 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5f6b534-2270-42a7-a40b-217536f35449 req-f214bd7f-3288-48eb-8ff1-3810ec0c3015 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:10.779886 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c5f6b534-2270-42a7-a40b-217536f35449 req-f214bd7f-3288-48eb-8ff1-3810ec0c3015 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=a15e051b-c130-4140-aaf2-a45ea7af5b43&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0445127 Nov 08 16:21:10.867506 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c5f6b534-2270-42a7-a40b-217536f35449 req-31404799-cb77-4ec6-af8c-5edabb2a2dd7 service neutron] 10.222.0.25 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0794907 Nov 08 16:21:10.961934 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c5f6b534-2270-42a7-a40b-217536f35449 req-0e01694e-2025-44b7-9bba-15334f183c83 service neutron] 10.222.0.25 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0848386 Nov 08 16:21:11.275532 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9fd8962-946d-4875-9e59-efadd547df1c req-1998cd43-3ae0-4129-afc4-1258cca329e8 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:11.276977 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d9fd8962-946d-4875-9e59-efadd547df1c req-1998cd43-3ae0-4129-afc4-1258cca329e8 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 943 time: 0.0482893 Nov 08 16:21:11.325832 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d9fd8962-946d-4875-9e59-efadd547df1c req-2fb14f17-8da3-4550-9437-2652457268f1 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430660 Nov 08 16:21:11.550449 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:12.442648 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-622c281b-e09d-471c-acb3-0d84ddc0d4de req-2729db5c-3147-466f-b8fc-a58bf08870a0 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:12.444084 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-622c281b-e09d-471c-acb3-0d84ddc0d4de req-2729db5c-3147-466f-b8fc-a58bf08870a0 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 943 time: 0.0511303 Nov 08 16:21:12.491187 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-622c281b-e09d-471c-acb3-0d84ddc0d4de req-cc83e519-e015-40ff-a6d6-0f4723b8e42b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414472 Nov 08 16:21:13.286098 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:13.605410 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7368fe3-ea33-4fec-99ad-a05781ebc93e req-41bda705-5452-431f-b990-99a2825b474f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:13.607108 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e7368fe3-ea33-4fec-99ad-a05781ebc93e req-41bda705-5452-431f-b990-99a2825b474f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 943 time: 0.0471888 Nov 08 16:21:13.655692 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e7368fe3-ea33-4fec-99ad-a05781ebc93e req-2a37a574-255e-4dfa-a970-0108a74299d0 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430682 Nov 08 16:21:13.965497 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:14.771602 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffe40913-2383-4310-a432-8e6fef25cab3 req-154bf441-e5f6-4a1d-a328-33b87f7002e5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:14.773068 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ffe40913-2383-4310-a432-8e6fef25cab3 req-154bf441-e5f6-4a1d-a328-33b87f7002e5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 943 time: 0.0493481 Nov 08 16:21:14.824930 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ffe40913-2383-4310-a432-8e6fef25cab3 req-ecd2de5b-b3ec-4806-a720-f293bb96f501 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0460677 Nov 08 16:21:15.939481 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5af49783-e116-41b6-9ee5-0e294deb45ee req-080d9bf7-a7e5-4258-bbf7-e591a9f8dcb2 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:15.940924 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5af49783-e116-41b6-9ee5-0e294deb45ee req-080d9bf7-a7e5-4258-bbf7-e591a9f8dcb2 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 943 time: 0.0475399 Nov 08 16:21:15.988973 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5af49783-e116-41b6-9ee5-0e294deb45ee req-75f43b3a-1ebb-41f0-8fd3-4df70c4273c9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412405 Nov 08 16:21:17.102213 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1906de-ea43-4813-bcb1-10031d22cb6e req-6d7eff5d-39d8-4385-ada5-3e2885e99b03 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:17.103668 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1e1906de-ea43-4813-bcb1-10031d22cb6e req-6d7eff5d-39d8-4385-ada5-3e2885e99b03 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 943 time: 0.0476043 Nov 08 16:21:17.150977 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1e1906de-ea43-4813-bcb1-10031d22cb6e req-eee9b779-7793-40b4-8831-81ba7c5190e6 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414495 Nov 08 16:21:17.978383 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:18.268844 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce7035c-403b-421a-9d3c-11f7106ba08b req-ce55d4d0-a7cd-49e2-b263-d2f0bae36e01 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:18.270910 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7ce7035c-403b-421a-9d3c-11f7106ba08b req-ce55d4d0-a7cd-49e2-b263-d2f0bae36e01 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 943 time: 0.0522726 Nov 08 16:21:18.318639 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7ce7035c-403b-421a-9d3c-11f7106ba08b req-5773eb20-e1a1-4abf-bbfd-93e96d3aa6e7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415192 Nov 08 16:21:19.429010 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68fe4749-0f1d-4455-9179-e1135a7a0a22 req-02f0a6ca-dfee-49b3-b4e4-066704b48352 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:19.430473 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-68fe4749-0f1d-4455-9179-e1135a7a0a22 req-02f0a6ca-dfee-49b3-b4e4-066704b48352 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 943 time: 0.0469656 Nov 08 16:21:19.478188 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-68fe4749-0f1d-4455-9179-e1135a7a0a22 req-2c3b366a-01f2-4662-8347-6cde10a5c651 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419459 Nov 08 16:21:20.293148 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-09df4a14-f08b-4425-95c3-b520f844b477 req-acca1b91-0769-4ad5-a46a-5b54e5bc19e6 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0377591 Nov 08 16:21:20.356806 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09df4a14-f08b-4425-95c3-b520f844b477 req-70704557-12a9-4d16-80c1-ca45d32ea496 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:20.358352 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-09df4a14-f08b-4425-95c3-b520f844b477 req-70704557-12a9-4d16-80c1-ca45d32ea496 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=343d5ca096394f87bea0950aa3811a13&device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 1098 time: 0.0430863 Nov 08 16:21:20.463093 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09df4a14-f08b-4425-95c3-b520f844b477 req-625a389e-d9e0-4345-9277-4ee238b88967 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:20.464546 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-09df4a14-f08b-4425-95c3-b520f844b477 req-625a389e-d9e0-4345-9277-4ee238b88967 service neutron] 10.222.0.25 "GET /v2.0/networks?id=a15e051b-c130-4140-aaf2-a45ea7af5b43 HTTP/1.1" status: 200 len: 913 time: 0.0859475 Nov 08 16:21:20.535811 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-09df4a14-f08b-4425-95c3-b520f844b477 req-04979787-5f15-4c22-b7ba-2404f71f3ced service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=794847db-0663-47ab-a2b0-4bdedb698598 HTTP/1.1" status: 200 len: 1001 time: 0.0625176 Nov 08 16:21:20.613520 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09df4a14-f08b-4425-95c3-b520f844b477 req-6c80ef2e-ba67-48e6-a13c-352c6c27d9dd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:20.614992 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-09df4a14-f08b-4425-95c3-b520f844b477 req-6c80ef2e-ba67-48e6-a13c-352c6c27d9dd service neutron] 10.222.0.25 "GET /v2.0/subnets?id=6e4d65b1-4f2c-453a-847c-970dff985732 HTTP/1.1" status: 200 len: 851 time: 0.0710950 Nov 08 16:21:20.628432 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1095a26f-a7d8-41df-bce2-02e2ceab3fdd req-31d707f6-6bbb-48e8-b396-dfdec546cceb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:20.629980 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1095a26f-a7d8-41df-bce2-02e2ceab3fdd req-31d707f6-6bbb-48e8-b396-dfdec546cceb tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 943 time: 0.0782416 Nov 08 16:21:20.730593 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1095a26f-a7d8-41df-bce2-02e2ceab3fdd req-f2e0fac9-ee4e-4bb8-8508-d9eadf6e7818 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0924184 Nov 08 16:21:20.732408 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09df4a14-f08b-4425-95c3-b520f844b477 req-4cf355ab-946c-4b28-9c3a-fd9f1d4c9fcf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:20.733810 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-09df4a14-f08b-4425-95c3-b520f844b477 req-4cf355ab-946c-4b28-9c3a-fd9f1d4c9fcf service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=a15e051b-c130-4140-aaf2-a45ea7af5b43&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1029739 Nov 08 16:21:20.736345 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device ac61ca49-2eb1-4040-99b3-1fc5285b703f details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:21:20.753481 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [req-09df4a14-f08b-4425-95c3-b520f844b477 req-96567b59-ed9a-48f6-b88e-d501bb7fa255 service neutron] http://10.222.0.37:9696/v2.0/extensions returned with HTTP 200 {{(pid=101244) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 16:21:20.754584 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-09df4a14-f08b-4425-95c3-b520f844b477 req-96567b59-ed9a-48f6-b88e-d501bb7fa255 service neutron] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0098011 Nov 08 16:21:20.765477 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13c288aa-3d1c-4eff-a9f2-9cbc1c21f56f req-fca42523-87f3-4715-8e66-e23730a02806 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:20.766932 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-13c288aa-3d1c-4eff-a9f2-9cbc1c21f56f req-fca42523-87f3-4715-8e66-e23730a02806 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.0700595 Nov 08 16:21:20.829228 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port ac61ca49-2eb1-4040-99b3-1fc5285b703f, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=ac61ca49-2eb1-4040-99b3-1fc5285b703f,segment=NetworkSegment(1383b9f8-d178-4a90-828c-184fa1886253),segment_id=1383b9f8-d178-4a90-828c-184fa1886253)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:21:20.846962 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': 'ac61ca49-2eb1-4040-99b3-1fc5285b703f', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'port_id': 'ac61ca49-2eb1-4040-99b3-1fc5285b703f', 'mac_address': 'fa:16:3e:74:5e:30', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 161, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:21:20.889702 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:20.902935 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ac61ca49-2eb1-4040-99b3-1fc5285b703f {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:21:20.923255 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port ac61ca49-2eb1-4040-99b3-1fc5285b703f, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=ac61ca49-2eb1-4040-99b3-1fc5285b703f,segment=NetworkSegment(1383b9f8-d178-4a90-828c-184fa1886253),segment_id=1383b9f8-d178-4a90-828c-184fa1886253)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:21:20.928493 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:20.976549 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=ac61ca49-2eb1-4040-99b3-1fc5285b703f,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:20.983797 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:20.984136 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:20.984468 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:20.984789 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:20.985115 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:20.985433 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:20.985769 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:20.986089 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:20.986429 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:20.986741 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:20.987055 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:20.987364 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:21.098702 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-13c288aa-3d1c-4eff-a9f2-9cbc1c21f56f req-b18a99cf-7765-4234-94fd-64221429acef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3234973 Nov 08 16:21:21.118992 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-09df4a14-f08b-4425-95c3-b520f844b477 req-a23dfd74-6b56-47e3-915d-ea8269e56fa6 service neutron] 10.222.0.25 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3511567 Nov 08 16:21:21.206948 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-09df4a14-f08b-4425-95c3-b520f844b477 req-a927b16d-143f-42a1-947d-71b19f53de5e service neutron] 10.222.0.25 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0796747 Nov 08 16:21:21.366354 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['ac61ca49-2eb1-4040-99b3-1fc5285b703f'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:21:21.843891 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aad2da6-1f6a-480b-a05d-40bbef1fc5b7 req-cc19aa49-f094-46d3-8164-af0c7b4acde2 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:21.845297 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8aad2da6-1f6a-480b-a05d-40bbef1fc5b7 req-cc19aa49-f094-46d3-8164-af0c7b4acde2 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 944 time: 0.0478110 Nov 08 16:21:21.896321 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8aad2da6-1f6a-480b-a05d-40bbef1fc5b7 req-dcf9026e-e64f-4d0b-8e65-2a35237d3a6b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451546 Nov 08 16:21:22.218580 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62f860af-884e-40dd-9254-18d7703c3e37 req-a452afe9-dca1-4a2f-b095-bd2c750cec31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:22.220080 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-62f860af-884e-40dd-9254-18d7703c3e37 req-a452afe9-dca1-4a2f-b095-bd2c750cec31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.0478446 Nov 08 16:21:22.266552 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-62f860af-884e-40dd-9254-18d7703c3e37 req-60135a07-f875-4ff2-a5d1-597236ae37b0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400467 Nov 08 16:21:22.730441 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device ac61ca49-2eb1-4040-99b3-1fc5285b703f up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:21:22.779276 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning for port ac61ca49-2eb1-4040-99b3-1fc5285b703f completed by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 16:21:22.783141 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port ac61ca49-2eb1-4040-99b3-1fc5285b703f triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:21:22.783502 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:22.861485 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:22.890506 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f664b3dd-4458-4525-926a-1321ff188fdc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ac61ca49-2eb1-4040-99b3-1fc5285b703f'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:21:22.892670 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a67c3ff6-d966-4bdb-89bb-a7f232f8da34" -d '{"events": [{"server_uuid": "f664b3dd-4458-4525-926a-1321ff188fdc", "name": "network-vif-plugged", "status": "completed", "tag": "ac61ca49-2eb1-4040-99b3-1fc5285b703f"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:21:22.904579 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port ac61ca49-2eb1-4040-99b3-1fc5285b703f, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=ac61ca49-2eb1-4040-99b3-1fc5285b703f,segment=NetworkSegment(1383b9f8-d178-4a90-828c-184fa1886253),segment_id=1383b9f8-d178-4a90-828c-184fa1886253)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:21:22.908440 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:22.931338 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:21:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-af01f1d6-400a-4c37-a59f-f07de1b6e828 x-openstack-request-id: req-af01f1d6-400a-4c37-a59f-f07de1b6e828 {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:21:22.931617 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f664b3dd-4458-4525-926a-1321ff188fdc", "name": "network-vif-plugged", "status": "completed", "tag": "ac61ca49-2eb1-4040-99b3-1fc5285b703f", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:21:22.931866 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-af01f1d6-400a-4c37-a59f-f07de1b6e828 {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:21:22.932248 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f664b3dd-4458-4525-926a-1321ff188fdc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ac61ca49-2eb1-4040-99b3-1fc5285b703f', 'code': 200} Nov 08 16:21:22.958438 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=ac61ca49-2eb1-4040-99b3-1fc5285b703f,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:23.018047 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1d6a9f4-af25-4ab5-b3ed-c5387c67fdf9 req-59924aed-cdd4-4be7-ab96-a7875c8866d5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:23.020347 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c1d6a9f4-af25-4ab5-b3ed-c5387c67fdf9 req-59924aed-cdd4-4be7-ab96-a7875c8866d5 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 945 time: 0.0487382 Nov 08 16:21:23.067569 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c1d6a9f4-af25-4ab5-b3ed-c5387c67fdf9 req-9658133f-496c-4f77-b2ae-0dbd4dbc0e4f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415792 Nov 08 16:21:23.189696 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2576438-98df-46be-9bbd-4f16c2c67645 req-db82f093-6962-46ab-9113-5c098862b06a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:23.191692 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e2576438-98df-46be-9bbd-4f16c2c67645 req-db82f093-6962-46ab-9113-5c098862b06a service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 1098 time: 0.0403085 Nov 08 16:21:23.241153 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e2576438-98df-46be-9bbd-4f16c2c67645 req-b3725ca6-b058-4161-83a2-a0771217d447 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406232 Nov 08 16:21:23.384037 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6b2e0b-2485-454c-8a8d-9873ab33c1b0 req-d188f468-9517-4158-bffa-fcc75b007db5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:23.385482 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4a6b2e0b-2485-454c-8a8d-9873ab33c1b0 req-d188f468-9517-4158-bffa-fcc75b007db5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.0471103 Nov 08 16:21:23.430422 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4a6b2e0b-2485-454c-8a8d-9873ab33c1b0 req-2479343e-29d5-4d90-a560-734475b05357 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0391514 Nov 08 16:21:24.184065 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0c0ad23-582e-437b-8e3d-0f1f0c047085 req-0a48de8c-df3a-4b55-ba1c-e6d0bd0d3a8b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:24.185521 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c0c0ad23-582e-437b-8e3d-0f1f0c047085 req-0a48de8c-df3a-4b55-ba1c-e6d0bd0d3a8b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 945 time: 0.0480452 Nov 08 16:21:24.235755 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c0c0ad23-582e-437b-8e3d-0f1f0c047085 req-6c6124a8-6e19-4b48-a8c5-187302ac604c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438955 Nov 08 16:21:24.548684 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95aa4660-b7f2-4e76-bc89-4f0146ceb9c8 req-fd202185-c89a-4d48-a14a-d70bdc7b0a8e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:24.550156 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-95aa4660-b7f2-4e76-bc89-4f0146ceb9c8 req-fd202185-c89a-4d48-a14a-d70bdc7b0a8e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.0469899 Nov 08 16:21:24.595105 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-95aa4660-b7f2-4e76-bc89-4f0146ceb9c8 req-e1a5a0db-464f-40a5-b21d-04e69d183b80 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0388432 Nov 08 16:21:25.008816 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4252251a-330e-46cc-a88b-d670138f1015 req-abcae9b5-ae10-44ed-b132-c1366ec40c49 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-265532524&fields=id&tenant_id=9ad6e5c060034b2ca263bfdcb07fe807 HTTP/1.1" status: 200 len: 267 time: 0.0420368 Nov 08 16:21:25.060283 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4252251a-330e-46cc-a88b-d670138f1015 req-51406f45-6913-4808-b998-84a240a8893f tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:25.061773 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4252251a-330e-46cc-a88b-d670138f1015 req-51406f45-6913-4808-b998-84a240a8893f tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 984 time: 0.0475118 Nov 08 16:21:25.073373 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-4252251a-330e-46cc-a88b-d670138f1015 req-7572dafb-d5b3-4269-8432-3a309aa3af55 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Request body: {'port': {'security_groups': ['1d0afe5a-015d-4e87-a876-479fff7e7b28']}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:21:25.145502 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-4252251a-330e-46cc-a88b-d670138f1015 req-7572dafb-d5b3-4269-8432-3a309aa3af55 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:25.324740 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-4252251a-330e-46cc-a88b-d670138f1015 req-7572dafb-d5b3-4269-8432-3a309aa3af55 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] For port 304e385a-c4e3-48f0-8723-230b5da69dc3, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=304e385a-c4e3-48f0-8723-230b5da69dc3,segment=NetworkSegment(1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3),segment_id=1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:21:25.353481 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-4252251a-330e-46cc-a88b-d670138f1015 req-7572dafb-d5b3-4269-8432-3a309aa3af55 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:25.365521 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-4252251a-330e-46cc-a88b-d670138f1015 req-7572dafb-d5b3-4269-8432-3a309aa3af55 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:25.384356 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['304e385a-c4e3-48f0-8723-230b5da69dc3'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:21:25.439169 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4252251a-330e-46cc-a88b-d670138f1015 req-7572dafb-d5b3-4269-8432-3a309aa3af55 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:25.439805 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-4252251a-330e-46cc-a88b-d670138f1015 req-7572dafb-d5b3-4269-8432-3a309aa3af55 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:25.441232 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4252251a-330e-46cc-a88b-d670138f1015 req-7572dafb-d5b3-4269-8432-3a309aa3af55 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "PUT /v2.0/ports/304e385a-c4e3-48f0-8723-230b5da69dc3 HTTP/1.1" status: 200 len: 942 time: 0.3721943 Nov 08 16:21:25.441683 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912', 'tag': '304e385a-c4e3-48f0-8723-230b5da69dc3'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:21:25.443943 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1a282cd1-e55f-4088-8b3b-929e372b0e50" -d '{"events": [{"name": "network-changed", "server_uuid": "4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912", "tag": "304e385a-c4e3-48f0-8723-230b5da69dc3"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:21:25.448003 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 41570) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:25.463851 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7572dafb-d5b3-4269-8432-3a309aa3af55 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Pushing event updated for resources: {'Port': ['ID=304e385a-c4e3-48f0-8723-230b5da69dc3,revision_number=7']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:25.477411 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d4bc1c8-6e2d-4b77-a177-0da7a364c870 req-a4fbc959-87aa-4fd1-aef5-c2a6cb3ede9e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:25.486773 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9d4bc1c8-6e2d-4b77-a177-0da7a364c870 req-a4fbc959-87aa-4fd1-aef5-c2a6cb3ede9e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 945 time: 0.1809514 Nov 08 16:21:25.523690 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['304e385a-c4e3-48f0-8723-230b5da69dc3'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:21:25.548869 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:21:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6727b1a1-3025-4e4c-ba4e-1918c5994f63 x-openstack-request-id: req-6727b1a1-3025-4e4c-ba4e-1918c5994f63 {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:21:25.549166 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912", "tag": "304e385a-c4e3-48f0-8723-230b5da69dc3", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:21:25.549415 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-6727b1a1-3025-4e4c-ba4e-1918c5994f63 {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:21:25.549934 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912', 'tag': '304e385a-c4e3-48f0-8723-230b5da69dc3', 'status': 'completed', 'code': 200} Nov 08 16:21:25.564110 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9d4bc1c8-6e2d-4b77-a177-0da7a364c870 req-e88eaaad-6f25-44c3-8a7a-8d85a5b58bd4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0744953 Nov 08 16:21:25.595627 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-cb8aeef1-d1fb-4fd3-a016-489afabf71f9 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:25.651638 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-cb8aeef1-d1fb-4fd3-a016-489afabf71f9 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:25.690303 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a282cd1-e55f-4088-8b3b-929e372b0e50 req-bb70dae4-666a-43c9-8ddb-61ddf8373a05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:25.692531 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1a282cd1-e55f-4088-8b3b-929e372b0e50 req-bb70dae4-666a-43c9-8ddb-61ddf8373a05 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=9ad6e5c060034b2ca263bfdcb07fe807&device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 1098 time: 0.1052241 Nov 08 16:21:25.744785 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-cb8aeef1-d1fb-4fd3-a016-489afabf71f9 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:25.748256 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-cb8aeef1-d1fb-4fd3-a016-489afabf71f9 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:25.749403 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-cb8aeef1-d1fb-4fd3-a016-489afabf71f9 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "DELETE /v2.0/security-groups/1d27de4f-b93c-4054-9b9d-62a7c87a8620 HTTP/1.1" status: 204 len: 168 time: 0.3004148 Nov 08 16:21:25.752966 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 41582) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:25.762418 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb8aeef1-d1fb-4fd3-a016-489afabf71f9 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1d27de4f-b93c-4054-9b9d-62a7c87a8620,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:25.810347 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-3308c2fe-cb24-4395-bcbd-81d982d6502f None None] Provisioning complete for port 304e385a-c4e3-48f0-8723-230b5da69dc3 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:21:25.810823 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-3308c2fe-cb24-4395-bcbd-81d982d6502f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:25.813523 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8aeef1-d1fb-4fd3-a016-489afabf71f9 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:25.814084 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8aeef1-d1fb-4fd3-a016-489afabf71f9 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:25.814578 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8aeef1-d1fb-4fd3-a016-489afabf71f9 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:25.815112 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8aeef1-d1fb-4fd3-a016-489afabf71f9 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:25.815454 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8aeef1-d1fb-4fd3-a016-489afabf71f9 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:25.815833 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8aeef1-d1fb-4fd3-a016-489afabf71f9 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:25.816351 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8aeef1-d1fb-4fd3-a016-489afabf71f9 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:25.816694 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8aeef1-d1fb-4fd3-a016-489afabf71f9 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:25.817008 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8aeef1-d1fb-4fd3-a016-489afabf71f9 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:25.817330 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8aeef1-d1fb-4fd3-a016-489afabf71f9 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:25.817653 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8aeef1-d1fb-4fd3-a016-489afabf71f9 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:25.818007 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8aeef1-d1fb-4fd3-a016-489afabf71f9 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:25.838992 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c5bdab2-2ced-4680-97f4-21eb394488a2 req-7ad231d1-2dc0-412d-b169-5673a1ece3fd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:25.840611 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0c5bdab2-2ced-4680-97f4-21eb394488a2 req-7ad231d1-2dc0-412d-b169-5673a1ece3fd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.1471138 Nov 08 16:21:25.854504 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-450bcc60-242f-48a9-809b-f6f3b61decb3 req-e2a60dc2-db2d-42db-ae5a-041d0c38c7f9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:25.856213 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-450bcc60-242f-48a9-809b-f6f3b61decb3 req-e2a60dc2-db2d-42db-ae5a-041d0c38c7f9 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 945 time: 0.1980023 Nov 08 16:21:25.916638 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a282cd1-e55f-4088-8b3b-929e372b0e50 req-ec32e28a-7e7a-475f-9f90-4e6061f6f6f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:25.918487 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1a282cd1-e55f-4088-8b3b-929e372b0e50 req-ec32e28a-7e7a-475f-9f90-4e6061f6f6f9 service neutron] 10.222.0.25 "GET /v2.0/networks?id=52eb1d65-dc7c-45c5-9521-97cb18715837 HTTP/1.1" status: 200 len: 915 time: 0.2146640 Nov 08 16:21:25.940660 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-7575609a-4975-4489-842f-81c735fe7b7d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Deleting port 2d5c2aab-de16-4ae7-a212-4e4444dfd64f {{(pid=101245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:21:25.941034 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7575609a-4975-4489-842f-81c735fe7b7d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:25.988615 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0c5bdab2-2ced-4680-97f4-21eb394488a2 req-ea5a38a0-ee66-479b-9fd6-297b2a079ef6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1293736 Nov 08 16:21:26.013932 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-450bcc60-242f-48a9-809b-f6f3b61decb3 req-6564b39e-3173-4742-ba47-74c4ee27ebc7 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1379087 Nov 08 16:21:26.015050 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7575609a-4975-4489-842f-81c735fe7b7d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:26.015437 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7575609a-4975-4489-842f-81c735fe7b7d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:26.016101 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1a282cd1-e55f-4088-8b3b-929e372b0e50 req-0c70353a-4d57-457d-9b96-7b49bb0bdff9 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=304e385a-c4e3-48f0-8723-230b5da69dc3 HTTP/1.1" status: 200 len: 1001 time: 0.0788791 Nov 08 16:21:26.030034 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-7575609a-4975-4489-842f-81c735fe7b7d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling delete_port for 2d5c2aab-de16-4ae7-a212-4e4444dfd64f owned by network:floatingip {{(pid=101245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:21:26.031601 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 41584) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:26.074430 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a282cd1-e55f-4088-8b3b-929e372b0e50 req-afb939ac-b0ba-4c06-89b4-cf8720d3e8cf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:26.076006 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1a282cd1-e55f-4088-8b3b-929e372b0e50 req-afb939ac-b0ba-4c06-89b4-cf8720d3e8cf service neutron] 10.222.0.25 "GET /v2.0/subnets?id=12999abd-2828-4905-aed0-938c2f27aed8 HTTP/1.1" status: 200 len: 853 time: 0.0492785 Nov 08 16:21:26.136161 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a282cd1-e55f-4088-8b3b-929e372b0e50 req-db08fabc-9dd8-471b-9d4e-58357483edf4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:26.137812 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1a282cd1-e55f-4088-8b3b-929e372b0e50 req-db08fabc-9dd8-471b-9d4e-58357483edf4 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=52eb1d65-dc7c-45c5-9521-97cb18715837&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0529845 Nov 08 16:21:26.216067 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a68ccc1-a93b-4f3d-a613-1e9ef1bf371c tempest-TestVolumeBootPattern-411305480 tempest-TestVolumeBootPattern-411305480-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:26.217564 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-5a68ccc1-a93b-4f3d-a613-1e9ef1bf371c tempest-TestVolumeBootPattern-411305480 tempest-TestVolumeBootPattern-411305480-project-admin] 10.222.0.37 "GET /v2.0/ports?device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 1093 time: 0.1849937 Nov 08 16:21:26.220491 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 41588) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:26.226114 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-1a2fe3b5-bf31-4e74-a872-53cd32c53677 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Request body: {'floatingip': {'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'port_id': 'ac61ca49-2eb1-4040-99b3-1fc5285b703f', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'fixed_ip_address': '172.20.0.6'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:21:26.229639 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1a282cd1-e55f-4088-8b3b-929e372b0e50 req-ef4cfa96-de05-47c2-9f31-aafcd8f8df15 service neutron] 10.222.0.25 "GET /v2.0/networks/52eb1d65-dc7c-45c5-9521-97cb18715837?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0838690 Nov 08 16:21:26.283289 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1a2fe3b5-bf31-4e74-a872-53cd32c53677 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for floatingip, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:26.286213 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7575609a-4975-4489-842f-81c735fe7b7d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:26.325375 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1a282cd1-e55f-4088-8b3b-929e372b0e50 req-536bf7cc-9b31-457d-a498-952e87ee114e service neutron] 10.222.0.25 "GET /v2.0/networks/52eb1d65-dc7c-45c5-9521-97cb18715837?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0880849 Nov 08 16:21:26.345752 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7575609a-4975-4489-842f-81c735fe7b7d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Pushing event deleted for resources: {'Port': ['ID=2d5c2aab-de16-4ae7-a212-4e4444dfd64f,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:26.653594 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7575609a-4975-4489-842f-81c735fe7b7d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks [] for floatingip, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:26.654341 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.db.l3_db [None req-7575609a-4975-4489-842f-81c735fe7b7d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Floating IP 118c0941-b7aa-470c-a5b1-6341e4cd967c disassociated (deleted). External IP: 172.27.3.193, port: 304e385a-c4e3-48f0-8723-230b5da69dc3. Nov 08 16:21:26.765173 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1a2fe3b5-bf31-4e74-a872-53cd32c53677 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:26.956037 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_common [None req-1a2fe3b5-bf31-4e74-a872-53cd32c53677 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Allocated IP 172.27.3.239 (68f46265-b42a-49a0-8d57-f9362045cd9b/4728e4be-5a19-43c0-89cf-ced2a190645d/11c207a7-6dfe-42ce-b33f-58a81860a38d) {{(pid=101245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:21:26.971090 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7575609a-4975-4489-842f-81c735fe7b7d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Router 3aa8420d-7378-4033-af1d-6dae369fd742 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101245) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:21:27.110341 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53770596-641c-4a8a-bd7e-cc5f95347b76 req-a65ccbbf-d6b3-45e5-9038-6b2addd8d0e4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:27.111861 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-53770596-641c-4a8a-bd7e-cc5f95347b76 req-a65ccbbf-d6b3-45e5-9038-6b2addd8d0e4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.0507481 Nov 08 16:21:27.139357 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1a2fe3b5-bf31-4e74-a872-53cd32c53677 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for port, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:27.160223 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7575609a-4975-4489-842f-81c735fe7b7d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101245) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:21:27.165607 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7575609a-4975-4489-842f-81c735fe7b7d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for floatingip, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:27.176212 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8826bb27-144c-412e-b2b0-81944dcde4c4 None None] Sync routers for ids ['3aa8420d-7378-4033-af1d-6dae369fd742'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:21:27.180252 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-53770596-641c-4a8a-bd7e-cc5f95347b76 req-21f863ba-a62c-4d90-aba1-4d2b628f3cff tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0599427 Nov 08 16:21:27.192789 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8826bb27-144c-412e-b2b0-81944dcde4c4 None None] Routers {'3aa8420d-7378-4033-af1d-6dae369fd742'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:21:27.194079 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-8826bb27-144c-412e-b2b0-81944dcde4c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:21:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['3aa8420d-7378-4033-af1d-6dae369fd742'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:27.206870 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-7575609a-4975-4489-842f-81c735fe7b7d tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "DELETE /v2.0/floatingips/118c0941-b7aa-470c-a5b1-6341e4cd967c HTTP/1.1" status: 204 len: 168 time: 1.4430604 Nov 08 16:21:27.206870 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912', 'tag': '304e385a-c4e3-48f0-8723-230b5da69dc3'}] {{(pid=101245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:21:27.208661 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9303bddee447de525cefc409d3d14f9dbe8ef1f21bfe9eb24fdef2609d4aa3c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2fb368f4-a54c-4ede-94a4-e98e118eae3f" -d '{"events": [{"name": "network-changed", "server_uuid": "4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912", "tag": "304e385a-c4e3-48f0-8723-230b5da69dc3"}]}' {{(pid=101245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:21:27.218922 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1a2fe3b5-bf31-4e74-a872-53cd32c53677 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:27.262304 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a2fe3b5-bf31-4e74-a872-53cd32c53677 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Network 68f46265-b42a-49a0-8d57-f9362045cd9b is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:21:27.267442 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-1a2fe3b5-bf31-4e74-a872-53cd32c53677 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:21:27.274798 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a2fe3b5-bf31-4e74-a872-53cd32c53677 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Received port after_create {{(pid=101245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:21:27.296576 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a2fe3b5-bf31-4e74-a872-53cd32c53677 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Pushing event updated for resources: {'Port': ['ID=11c207a7-6dfe-42ce-b33f-58a81860a38d,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:27.352392 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-8826bb27-144c-412e-b2b0-81944dcde4c4 None None] Set router 3aa8420d-7378-4033-af1d-6dae369fd742 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:21:27.467549 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:21:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e69ed53c-f426-4563-91c3-6661c01b6c57 x-openstack-request-id: req-e69ed53c-f426-4563-91c3-6661c01b6c57 {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:21:27.468069 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912", "tag": "304e385a-c4e3-48f0-8723-230b5da69dc3", "status": "completed", "code": 200}]} {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:21:27.468318 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-e69ed53c-f426-4563-91c3-6661c01b6c57 {{(pid=101245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:21:27.469231 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912', 'tag': '304e385a-c4e3-48f0-8723-230b5da69dc3', 'status': 'completed', 'code': 200} Nov 08 16:21:27.542073 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fb368f4-a54c-4ede-94a4-e98e118eae3f req-e59c69d7-2bcb-4588-821a-ec8c126ae927 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:27.543744 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2fb368f4-a54c-4ede-94a4-e98e118eae3f req-e59c69d7-2bcb-4588-821a-ec8c126ae927 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=9ad6e5c060034b2ca263bfdcb07fe807&device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 1098 time: 0.0518024 Nov 08 16:21:27.582417 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-8826bb27-144c-412e-b2b0-81944dcde4c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'name': 'tempest-TestMinimumBasicScenario-138746869-router', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148'}], 'enable_snat': True}, 'gw_port_id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:17:03Z', 'updated_at': '2021-11-08T16:17:07Z', 'revision_number': 4, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'gw_port': {'id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:1c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:04Z', 'updated_at': '2021-11-08T16:17:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '1530a0fe-3181-4905-89a0-9606e9ca5a5f', 'name': '', 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'mac_address': 'fa:16:3e:20:1e:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'device_owner': 'network:router_interface', 'standard_attr_id': 479, 'fixed_ips': [{'subnet_id': '12999abd-2828-4905-aed0-938c2f27aed8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:06Z', 'updated_at': '2021-11-08T16:17:13Z', 'revision_number': 5, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'subnets': [{'id': '12999abd-2828-4905-aed0-938c2f27aed8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:27.608790 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8826bb27-144c-412e-b2b0-81944dcde4c4 None None] Checking router: 3aa8420d-7378-4033-af1d-6dae369fd742 for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:21:27.617897 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8826bb27-144c-412e-b2b0-81944dcde4c4 None None] Routers {'3aa8420d-7378-4033-af1d-6dae369fd742'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:21:27.618511 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-8826bb27-144c-412e-b2b0-81944dcde4c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:21:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['3aa8420d-7378-4033-af1d-6dae369fd742'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:27.647130 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fb368f4-a54c-4ede-94a4-e98e118eae3f req-cb965d9a-e75c-420d-b421-01db18e6d378 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:27.648608 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2fb368f4-a54c-4ede-94a4-e98e118eae3f req-cb965d9a-e75c-420d-b421-01db18e6d378 service neutron] 10.222.0.25 "GET /v2.0/networks?id=52eb1d65-dc7c-45c5-9521-97cb18715837 HTTP/1.1" status: 200 len: 915 time: 0.0916491 Nov 08 16:21:27.691545 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2fb368f4-a54c-4ede-94a4-e98e118eae3f req-db8ec406-ecb7-4c09-964f-01dc25f73967 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=304e385a-c4e3-48f0-8723-230b5da69dc3 HTTP/1.1" status: 200 len: 217 time: 0.0343597 Nov 08 16:21:27.704858 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1a2fe3b5-bf31-4e74-a872-53cd32c53677 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:27.725177 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-8826bb27-144c-412e-b2b0-81944dcde4c4 None None] Set router 3aa8420d-7378-4033-af1d-6dae369fd742 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:21:27.740246 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fb368f4-a54c-4ede-94a4-e98e118eae3f req-f1e176da-0629-4e50-986d-bb5fa84e2503 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:27.742058 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2fb368f4-a54c-4ede-94a4-e98e118eae3f req-f1e176da-0629-4e50-986d-bb5fa84e2503 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=12999abd-2828-4905-aed0-938c2f27aed8 HTTP/1.1" status: 200 len: 853 time: 0.0432482 Nov 08 16:21:27.782008 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1a2fe3b5-bf31-4e74-a872-53cd32c53677 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:27.802504 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fb368f4-a54c-4ede-94a4-e98e118eae3f req-f79a4e26-e48d-47a7-ae64-ed7abe149b11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:27.804011 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2fb368f4-a54c-4ede-94a4-e98e118eae3f req-f79a4e26-e48d-47a7-ae64-ed7abe149b11 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=52eb1d65-dc7c-45c5-9521-97cb18715837&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0541520 Nov 08 16:21:27.914327 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2fb368f4-a54c-4ede-94a4-e98e118eae3f req-4a385e5c-bffb-421a-bf91-4bace8b9b3a5 service neutron] 10.222.0.25 "GET /v2.0/networks/52eb1d65-dc7c-45c5-9521-97cb18715837?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0832691 Nov 08 16:21:27.929731 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-8826bb27-144c-412e-b2b0-81944dcde4c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'name': 'tempest-TestMinimumBasicScenario-138746869-router', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148'}], 'enable_snat': True}, 'gw_port_id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:17:03Z', 'updated_at': '2021-11-08T16:17:07Z', 'revision_number': 4, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'gw_port': {'id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:1c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:04Z', 'updated_at': '2021-11-08T16:17:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '1530a0fe-3181-4905-89a0-9606e9ca5a5f', 'name': '', 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'mac_address': 'fa:16:3e:20:1e:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'device_owner': 'network:router_interface', 'standard_attr_id': 479, 'fixed_ips': [{'subnet_id': '12999abd-2828-4905-aed0-938c2f27aed8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:06Z', 'updated_at': '2021-11-08T16:17:13Z', 'revision_number': 5, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'subnets': [{'id': '12999abd-2828-4905-aed0-938c2f27aed8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:27.938542 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1a2fe3b5-bf31-4e74-a872-53cd32c53677 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for port, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:27.945012 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1a2fe3b5-bf31-4e74-a872-53cd32c53677 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7464016'] for port, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:27.956857 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8826bb27-144c-412e-b2b0-81944dcde4c4 None None] The sync data for ids ['3aa8420d-7378-4033-af1d-6dae369fd742'] in dv-cinder-816187-2-iscsi is: [{'id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'name': 'tempest-TestMinimumBasicScenario-138746869-router', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148'}], 'enable_snat': True}, 'gw_port_id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:17:03Z', 'updated_at': '2021-11-08T16:17:07Z', 'revision_number': 4, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'gw_port': {'id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:1c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:04Z', 'updated_at': '2021-11-08T16:17:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '1530a0fe-3181-4905-89a0-9606e9ca5a5f', 'name': '', 'network_id': '52eb1d65-dc7c-45c5-9521-97cb18715837', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'mac_address': 'fa:16:3e:20:1e:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'device_owner': 'network:router_interface', 'standard_attr_id': 479, 'fixed_ips': [{'subnet_id': '12999abd-2828-4905-aed0-938c2f27aed8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:06Z', 'updated_at': '2021-11-08T16:17:13Z', 'revision_number': 5, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'subnets': [{'id': '12999abd-2828-4905-aed0-938c2f27aed8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:21:28.022041 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-2fb368f4-a54c-4ede-94a4-e98e118eae3f req-88ecb0fc-7b6c-451e-a65a-8abedd58d159 service neutron] 10.222.0.25 "GET /v2.0/networks/52eb1d65-dc7c-45c5-9521-97cb18715837?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1002319 Nov 08 16:21:28.023669 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a2fe3b5-bf31-4e74-a872-53cd32c53677 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Pushing event updated for resources: {'Port': ['ID=11c207a7-6dfe-42ce-b33f-58a81860a38d,revision_number=2']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:28.030159 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1a2fe3b5-bf31-4e74-a872-53cd32c53677 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-2032271'] for floatingip, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:28.135181 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.db.l3_db [None req-1a2fe3b5-bf31-4e74-a872-53cd32c53677 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Floating IP 5857c991-9f76-4345-8258-25f45eff26e8 associated. External IP: 172.27.3.239, port: ac61ca49-2eb1-4040-99b3-1fc5285b703f. Nov 08 16:21:28.230408 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cba4ab5a-7e5c-490c-baaa-0b1d756587f1 None None] New status for floating IP 118c0941-b7aa-470c-a5b1-6341e4cd967c: DOWN {{(pid=101247) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 16:21:28.306989 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00a8d001-ffb8-4d78-9901-60a30bb2bec5 req-7e0f68e8-80e8-48b2-b4d4-9e9c7fefa713 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:28.314273 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-00a8d001-ffb8-4d78-9901-60a30bb2bec5 req-7e0f68e8-80e8-48b2-b4d4-9e9c7fefa713 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.0621550 Nov 08 16:21:28.363946 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1a2fe3b5-bf31-4e74-a872-53cd32c53677 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Router f80d01f3-bee2-4682-8f4a-92536ad96209 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101245) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:21:28.370427 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-00a8d001-ffb8-4d78-9901-60a30bb2bec5 req-15bb63a7-5ae5-42ab-a8a7-d21242cde61f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0549111 Nov 08 16:21:28.472370 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1a2fe3b5-bf31-4e74-a872-53cd32c53677 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101245) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:21:28.481324 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31f7c53f-05b4-4f61-bc9b-c738e039c747 None None] Sync routers for ids ['f80d01f3-bee2-4682-8f4a-92536ad96209'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:21:28.489302 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1a2fe3b5-bf31-4e74-a872-53cd32c53677 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for floatingip, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:28.490608 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31f7c53f-05b4-4f61-bc9b-c738e039c747 None None] Routers {'f80d01f3-bee2-4682-8f4a-92536ad96209'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:21:28.491214 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-31f7c53f-05b4-4f61-bc9b-c738e039c747 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:21:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['f80d01f3-bee2-4682-8f4a-92536ad96209'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:28.521750 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-1a2fe3b5-bf31-4e74-a872-53cd32c53677 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.2949305 Nov 08 16:21:28.605894 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-31f7c53f-05b4-4f61-bc9b-c738e039c747 None None] Set router f80d01f3-bee2-4682-8f4a-92536ad96209 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:21:28.838029 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-31f7c53f-05b4-4f61-bc9b-c738e039c747 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 4, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': '5857c991-9f76-4345-8258-25f45eff26e8', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'floating_ip_address': '172.27.3.239', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'port_id': 'ac61ca49-2eb1-4040-99b3-1fc5285b703f', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 555, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'mac_address': 'fa:16:3e:74:5e:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f664b3dd-4458-4525-926a-1321ff188fdc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:21:27Z', 'updated_at': '2021-11-08T16:21:27Z', 'revision_number': 0, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'fixed_ip_address_scope': None}, {'id': 'f569e85e-1fe4-4f0e-9589-b8abeab39e2b', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'floating_ip_address': '172.27.3.223', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'port_id': '794847db-0663-47ab-a2b0-4bdedb698598', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 536, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'mac_address': 'fa:16:3e:43:4e:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ce49cb3-8d64-40a5-9827-64fa1d2f37c2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:18:40Z', 'updated_at': '2021-11-08T16:18:41Z', 'revision_number': 1, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbdf39d9-310f-42ea-a1f1-4e1b15048b73', 'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'mac_address': 'fa:16:3e:13:ec:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_interface', 'standard_attr_id': 228, 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:28Z', 'updated_at': '2021-11-08T16:12:32Z', 'revision_number': 5, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'subnets': [{'id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:28.866267 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31f7c53f-05b4-4f61-bc9b-c738e039c747 None None] Checking router: f80d01f3-bee2-4682-8f4a-92536ad96209 for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:21:28.875164 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31f7c53f-05b4-4f61-bc9b-c738e039c747 None None] Routers {'f80d01f3-bee2-4682-8f4a-92536ad96209'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:21:28.875749 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-31f7c53f-05b4-4f61-bc9b-c738e039c747 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:21:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['f80d01f3-bee2-4682-8f4a-92536ad96209'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:29.095521 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-31f7c53f-05b4-4f61-bc9b-c738e039c747 None None] Set router f80d01f3-bee2-4682-8f4a-92536ad96209 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:21:29.317223 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-31f7c53f-05b4-4f61-bc9b-c738e039c747 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 4, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': '5857c991-9f76-4345-8258-25f45eff26e8', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'floating_ip_address': '172.27.3.239', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'port_id': 'ac61ca49-2eb1-4040-99b3-1fc5285b703f', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 555, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'mac_address': 'fa:16:3e:74:5e:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f664b3dd-4458-4525-926a-1321ff188fdc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:21:27Z', 'updated_at': '2021-11-08T16:21:27Z', 'revision_number': 0, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'fixed_ip_address_scope': None}, {'id': 'f569e85e-1fe4-4f0e-9589-b8abeab39e2b', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'floating_ip_address': '172.27.3.223', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'port_id': '794847db-0663-47ab-a2b0-4bdedb698598', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 536, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'mac_address': 'fa:16:3e:43:4e:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ce49cb3-8d64-40a5-9827-64fa1d2f37c2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:18:40Z', 'updated_at': '2021-11-08T16:18:41Z', 'revision_number': 1, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbdf39d9-310f-42ea-a1f1-4e1b15048b73', 'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'mac_address': 'fa:16:3e:13:ec:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_interface', 'standard_attr_id': 228, 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:28Z', 'updated_at': '2021-11-08T16:12:32Z', 'revision_number': 5, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'subnets': [{'id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:29.345448 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31f7c53f-05b4-4f61-bc9b-c738e039c747 None None] The sync data for ids ['f80d01f3-bee2-4682-8f4a-92536ad96209'] in dv-cinder-816187-2-iscsi is: [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 4, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': '5857c991-9f76-4345-8258-25f45eff26e8', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'floating_ip_address': '172.27.3.239', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'port_id': 'ac61ca49-2eb1-4040-99b3-1fc5285b703f', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 555, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'mac_address': 'fa:16:3e:74:5e:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f664b3dd-4458-4525-926a-1321ff188fdc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:21:27Z', 'updated_at': '2021-11-08T16:21:27Z', 'revision_number': 0, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'fixed_ip_address_scope': None}, {'id': 'f569e85e-1fe4-4f0e-9589-b8abeab39e2b', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'floating_ip_address': '172.27.3.223', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'port_id': '794847db-0663-47ab-a2b0-4bdedb698598', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 536, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'mac_address': 'fa:16:3e:43:4e:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ce49cb3-8d64-40a5-9827-64fa1d2f37c2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:18:40Z', 'updated_at': '2021-11-08T16:18:41Z', 'revision_number': 1, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbdf39d9-310f-42ea-a1f1-4e1b15048b73', 'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'mac_address': 'fa:16:3e:13:ec:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_interface', 'standard_attr_id': 228, 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:28Z', 'updated_at': '2021-11-08T16:12:32Z', 'revision_number': 5, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'subnets': [{'id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:21:29.470343 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f664b3dd-4458-4525-926a-1321ff188fdc', 'tag': 'ac61ca49-2eb1-4040-99b3-1fc5285b703f'}] {{(pid=101245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:21:29.472650 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9303bddee447de525cefc409d3d14f9dbe8ef1f21bfe9eb24fdef2609d4aa3c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a288ed35-5d3e-4ba6-a4b0-138a82243cd2" -d '{"events": [{"name": "network-changed", "server_uuid": "f664b3dd-4458-4525-926a-1321ff188fdc", "tag": "ac61ca49-2eb1-4040-99b3-1fc5285b703f"}]}' {{(pid=101245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:21:29.495332 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c866b53-60d8-48fa-a3fe-f27c268293e9 req-f7cf1481-49af-4327-8a07-362d9b232222 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:29.497029 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0c866b53-60d8-48fa-a3fe-f27c268293e9 req-f7cf1481-49af-4327-8a07-362d9b232222 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.0571780 Nov 08 16:21:29.545936 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-273c1984-7dc3-4cea-a857-44065c36c33a None None] New status for floating IP 5857c991-9f76-4345-8258-25f45eff26e8: ACTIVE {{(pid=101247) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 16:21:29.546793 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0c866b53-60d8-48fa-a3fe-f27c268293e9 req-7af38d4f-7268-4644-a14a-122a7eb23ca7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434070 Nov 08 16:21:29.582039 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:21:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cc86cdc0-7bcb-4dae-bd74-e6809277300d x-openstack-request-id: req-cc86cdc0-7bcb-4dae-bd74-e6809277300d {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:21:29.582331 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f664b3dd-4458-4525-926a-1321ff188fdc", "tag": "ac61ca49-2eb1-4040-99b3-1fc5285b703f", "status": "completed", "code": 200}]} {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:21:29.582582 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-cc86cdc0-7bcb-4dae-bd74-e6809277300d {{(pid=101245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:21:29.582979 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f664b3dd-4458-4525-926a-1321ff188fdc', 'tag': 'ac61ca49-2eb1-4040-99b3-1fc5285b703f', 'status': 'completed', 'code': 200} Nov 08 16:21:29.647887 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a288ed35-5d3e-4ba6-a4b0-138a82243cd2 req-54e79040-fbaf-43f8-8e86-90727485d737 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:29.649248 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a288ed35-5d3e-4ba6-a4b0-138a82243cd2 req-54e79040-fbaf-43f8-8e86-90727485d737 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=343d5ca096394f87bea0950aa3811a13&device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 1098 time: 0.0426922 Nov 08 16:21:29.739282 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a288ed35-5d3e-4ba6-a4b0-138a82243cd2 req-e25960de-937d-4863-b8f8-ca5d8c467112 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:29.740721 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a288ed35-5d3e-4ba6-a4b0-138a82243cd2 req-e25960de-937d-4863-b8f8-ca5d8c467112 service neutron] 10.222.0.25 "GET /v2.0/networks?id=a15e051b-c130-4140-aaf2-a45ea7af5b43 HTTP/1.1" status: 200 len: 913 time: 0.0839870 Nov 08 16:21:29.809702 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a288ed35-5d3e-4ba6-a4b0-138a82243cd2 req-87639ccb-6da2-44d0-9719-3ae923f78011 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=ac61ca49-2eb1-4040-99b3-1fc5285b703f HTTP/1.1" status: 200 len: 1001 time: 0.0598361 Nov 08 16:21:29.859456 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a288ed35-5d3e-4ba6-a4b0-138a82243cd2 req-306e7d08-675b-431c-ba33-bb039185bc2e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:29.860891 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a288ed35-5d3e-4ba6-a4b0-138a82243cd2 req-306e7d08-675b-431c-ba33-bb039185bc2e service neutron] 10.222.0.25 "GET /v2.0/subnets?id=6e4d65b1-4f2c-453a-847c-970dff985732 HTTP/1.1" status: 200 len: 851 time: 0.0435042 Nov 08 16:21:29.913750 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a288ed35-5d3e-4ba6-a4b0-138a82243cd2 req-60c91187-9948-4391-ad3e-5db31572f973 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:29.915293 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a288ed35-5d3e-4ba6-a4b0-138a82243cd2 req-60c91187-9948-4391-ad3e-5db31572f973 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=a15e051b-c130-4140-aaf2-a45ea7af5b43&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0458651 Nov 08 16:21:30.046096 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8803c8fd-5a37-40c3-881a-c2c882354bb1 req-821d6d3e-76da-49c7-b8f7-673749ed3410 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:30.047551 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8803c8fd-5a37-40c3-881a-c2c882354bb1 req-821d6d3e-76da-49c7-b8f7-673749ed3410 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 945 time: 0.0998242 Nov 08 16:21:30.052837 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a288ed35-5d3e-4ba6-a4b0-138a82243cd2 req-f2f7b49f-fbe1-40b8-ab82-bf7a4a288e5f service neutron] 10.222.0.25 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1221981 Nov 08 16:21:30.143102 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8803c8fd-5a37-40c3-881a-c2c882354bb1 req-81c00dd0-c455-429d-82de-78033c3d46b0 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0893478 Nov 08 16:21:30.170636 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a288ed35-5d3e-4ba6-a4b0-138a82243cd2 req-afbd17a4-6ce4-4bcc-b9f9-7d604cd55a56 service neutron] 10.222.0.25 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1039901 Nov 08 16:21:30.665873 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1037e4db-156e-401a-b5c0-e27e759621f8 req-d0691839-72c0-42b7-b44d-f6fa81828a9a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:30.667317 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1037e4db-156e-401a-b5c0-e27e759621f8 req-d0691839-72c0-42b7-b44d-f6fa81828a9a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.0495162 Nov 08 16:21:30.712744 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1037e4db-156e-401a-b5c0-e27e759621f8 req-96fc2473-ba5f-44e9-a830-ad27a0997345 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0395687 Nov 08 16:21:31.255827 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13a20cef-87d9-4783-b580-b5a9bcc7e079 req-60385e0f-f4cd-407d-9f48-364b224e9e26 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:31.257278 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-13a20cef-87d9-4783-b580-b5a9bcc7e079 req-60385e0f-f4cd-407d-9f48-364b224e9e26 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 945 time: 0.0462863 Nov 08 16:21:31.306080 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-13a20cef-87d9-4783-b580-b5a9bcc7e079 req-5f40e26d-9346-4b6a-b6b2-a364627dd522 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431480 Nov 08 16:21:31.829648 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e991ff17-37a8-464a-90d2-8a87f627dc17 req-b632524c-6a4f-4c5e-ab0f-1f147f5e2092 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:31.831033 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e991ff17-37a8-464a-90d2-8a87f627dc17 req-b632524c-6a4f-4c5e-ab0f-1f147f5e2092 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.0469780 Nov 08 16:21:31.877008 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e991ff17-37a8-464a-90d2-8a87f627dc17 req-658cee5e-d161-4227-b208-17522287a89a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0397401 Nov 08 16:21:32.416157 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c97c6a7-89cd-49b4-bda1-73f146fe7acb req-ede2769a-e28e-41dc-8706-257b337af1e7 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:32.417619 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3c97c6a7-89cd-49b4-bda1-73f146fe7acb req-ede2769a-e28e-41dc-8706-257b337af1e7 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 945 time: 0.0464616 Nov 08 16:21:32.462460 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3c97c6a7-89cd-49b4-bda1-73f146fe7acb req-4ed96fde-c3e4-42dd-bc3d-253166519e43 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/security-groups?id=1d0afe5a-015d-4e87-a876-479fff7e7b28&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390224 Nov 08 16:21:32.705932 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-590bc668-0074-445c-b66b-cbd8ddf293bf req-28b2b273-ac07-49e4-888b-d0b9b4a8f69b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:32.707834 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-590bc668-0074-445c-b66b-cbd8ddf293bf req-28b2b273-ac07-49e4-888b-d0b9b4a8f69b tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.25 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 945 time: 0.0507324 Nov 08 16:21:32.797216 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-590bc668-0074-445c-b66b-cbd8ddf293bf req-e3ac8fa7-4f38-4f71-8b7d-b1404fef425a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Deleting port 304e385a-c4e3-48f0-8723-230b5da69dc3 {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:21:32.797578 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-590bc668-0074-445c-b66b-cbd8ddf293bf req-e3ac8fa7-4f38-4f71-8b7d-b1404fef425a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:32.884805 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-590bc668-0074-445c-b66b-cbd8ddf293bf req-e3ac8fa7-4f38-4f71-8b7d-b1404fef425a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] For port 304e385a-c4e3-48f0-8723-230b5da69dc3, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=304e385a-c4e3-48f0-8723-230b5da69dc3,segment=NetworkSegment(1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3),segment_id=1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:21:32.885499 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-590bc668-0074-445c-b66b-cbd8ddf293bf req-e3ac8fa7-4f38-4f71-8b7d-b1404fef425a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:32.898223 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-590bc668-0074-445c-b66b-cbd8ddf293bf req-e3ac8fa7-4f38-4f71-8b7d-b1404fef425a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Calling delete_port for 304e385a-c4e3-48f0-8723-230b5da69dc3 owned by compute:nova {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:21:33.012072 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6913bfb-1edc-4144-8c8d-e70b9f2fa242 req-a9967a6e-651f-4f1e-b496-107581e6a393 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:33.013547 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c6913bfb-1edc-4144-8c8d-e70b9f2fa242 req-a9967a6e-651f-4f1e-b496-107581e6a393 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.0660844 Nov 08 16:21:33.089334 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-590bc668-0074-445c-b66b-cbd8ddf293bf req-e3ac8fa7-4f38-4f71-8b7d-b1404fef425a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:33.094298 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c6913bfb-1edc-4144-8c8d-e70b9f2fa242 req-d3b91ddb-964e-4f88-b4f7-5e3d8310502e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0577285 Nov 08 16:21:33.102196 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['304e385a-c4e3-48f0-8723-230b5da69dc3'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:21:33.123865 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3ac8fa7-4f38-4f71-8b7d-b1404fef425a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Pushing event deleted for resources: {'Port': ['ID=304e385a-c4e3-48f0-8723-230b5da69dc3,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:33.168018 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-590bc668-0074-445c-b66b-cbd8ddf293bf req-e3ac8fa7-4f38-4f71-8b7d-b1404fef425a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] No DVR routers for this DVR port 304e385a-c4e3-48f0-8723-230b5da69dc3 on host hv-cinder-81618 {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:21:33.170651 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-590bc668-0074-445c-b66b-cbd8ddf293bf req-e3ac8fa7-4f38-4f71-8b7d-b1404fef425a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:33.173964 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-590bc668-0074-445c-b66b-cbd8ddf293bf req-e3ac8fa7-4f38-4f71-8b7d-b1404fef425a tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.25 "DELETE /v2.0/ports/304e385a-c4e3-48f0-8723-230b5da69dc3 HTTP/1.1" status: 204 len: 173 time: 0.4588311 Nov 08 16:21:33.174395 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912', 'name': 'network-vif-deleted', 'tag': '304e385a-c4e3-48f0-8723-230b5da69dc3'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:21:33.176757 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-74c16854-0514-45f5-b22d-119ee604539f" -d '{"events": [{"server_uuid": "4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912", "name": "network-vif-deleted", "tag": "304e385a-c4e3-48f0-8723-230b5da69dc3"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:21:33.215020 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:21:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-de1cf9bd-b153-4307-832a-e2b7773b8c46 x-openstack-request-id: req-de1cf9bd-b153-4307-832a-e2b7773b8c46 {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:21:33.215310 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912", "name": "network-vif-deleted", "tag": "304e385a-c4e3-48f0-8723-230b5da69dc3", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:21:33.215553 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-de1cf9bd-b153-4307-832a-e2b7773b8c46 {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:21:33.215986 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912', 'name': 'network-vif-deleted', 'tag': '304e385a-c4e3-48f0-8723-230b5da69dc3', 'status': 'completed', 'code': 200} Nov 08 16:21:33.598758 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a816f484-a083-40d1-9d21-d6aa7670ae89 req-0a5d60e3-79e6-458a-8e47-62e1e25f1cc4 tempest-TestMinimumBasicScenario-700853414 tempest-TestMinimumBasicScenario-700853414-project] 10.222.0.37 "GET /v2.0/ports?device_id=4d8c5c1b-3540-4d8a-a2ec-1a1a802dd912 HTTP/1.1" status: 200 len: 210 time: 0.0384705 Nov 08 16:21:34.232297 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c12a5877-97d6-4f3e-8861-c7442410533a req-831d5899-8711-42eb-8881-43b9d46955e7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:34.233793 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c12a5877-97d6-4f3e-8861-c7442410533a req-831d5899-8711-42eb-8881-43b9d46955e7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.0478969 Nov 08 16:21:34.279171 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c12a5877-97d6-4f3e-8861-c7442410533a req-55ec614b-4602-4722-8a09-21d2219b163f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0397220 Nov 08 16:21:34.843575 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device b3094cea-72ef-41cf-ac88-a6d678f0fb09 details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:21:34.937638 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port b3094cea-72ef-41cf-ac88-a6d678f0fb09, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=b3094cea-72ef-41cf-ac88-a6d678f0fb09,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:21:34.949180 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': 'b3094cea-72ef-41cf-ac88-a6d678f0fb09', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'port_id': 'b3094cea-72ef-41cf-ac88-a6d678f0fb09', 'mac_address': 'fa:16:3e:a2:9b:c1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 188, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:21:34.986408 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:35.000106 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id b3094cea-72ef-41cf-ac88-a6d678f0fb09 {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:21:35.020697 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port b3094cea-72ef-41cf-ac88-a6d678f0fb09, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=b3094cea-72ef-41cf-ac88-a6d678f0fb09,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:21:35.025838 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:35.080822 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=b3094cea-72ef-41cf-ac88-a6d678f0fb09,revision_number=6']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:35.123802 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['b3094cea-72ef-41cf-ac88-a6d678f0fb09'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:21:35.304059 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 41708) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:35.441898 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c84f9af1-6227-4598-acfc-e84aba3a353c req-8dcc8ba6-53bf-48a0-bbea-e71142751ed2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:35.443249 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c84f9af1-6227-4598-acfc-e84aba3a353c req-8dcc8ba6-53bf-48a0-bbea-e71142751ed2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 945 time: 0.0887172 Nov 08 16:21:35.553883 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c84f9af1-6227-4598-acfc-e84aba3a353c req-97250f8b-d9d6-457e-b434-e2192f492938 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0803897 Nov 08 16:21:35.698153 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-2af0af78-9e3a-49c5-8401-57869ee185e6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-2033295'] for router_interface, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:35.930028 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-2af0af78-9e3a-49c5-8401-57869ee185e6 admin admin] Deleting port 1530a0fe-3181-4905-89a0-9606e9ca5a5f {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:21:35.930357 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-2af0af78-9e3a-49c5-8401-57869ee185e6 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:36.004897 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [None req-2af0af78-9e3a-49c5-8401-57869ee185e6 admin admin] For port 1530a0fe-3181-4905-89a0-9606e9ca5a5f, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=1530a0fe-3181-4905-89a0-9606e9ca5a5f,segment=NetworkSegment(1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3),segment_id=1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:21:36.005192 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-2af0af78-9e3a-49c5-8401-57869ee185e6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:36.020968 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-2af0af78-9e3a-49c5-8401-57869ee185e6 admin admin] Calling delete_port for 1530a0fe-3181-4905-89a0-9606e9ca5a5f owned by network:router_interface {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:21:36.415840 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-2af0af78-9e3a-49c5-8401-57869ee185e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:36.439395 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2af0af78-9e3a-49c5-8401-57869ee185e6 admin admin] Pushing event deleted for resources: {'Port': ['ID=1530a0fe-3181-4905-89a0-9606e9ca5a5f,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:36.599189 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-2af0af78-9e3a-49c5-8401-57869ee185e6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1599532', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-2034495'] for router_interface, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:36.735562 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcf26f87-b000-4993-a80d-309c3c07e3f9 req-866e3411-45c8-4801-869d-64dad9b5b7b9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:36.736903 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bcf26f87-b000-4993-a80d-309c3c07e3f9 req-866e3411-45c8-4801-869d-64dad9b5b7b9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 945 time: 0.0937550 Nov 08 16:21:36.824802 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bcf26f87-b000-4993-a80d-309c3c07e3f9 req-52eb2cad-ef56-48dd-8f47-2cbce8182794 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0805774 Nov 08 16:21:36.857459 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device b3094cea-72ef-41cf-ac88-a6d678f0fb09 up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:21:36.886059 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2af0af78-9e3a-49c5-8401-57869ee185e6 admin admin] Router 3aa8420d-7378-4033-af1d-6dae369fd742 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:21:36.904453 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port b3094cea-72ef-41cf-ac88-a6d678f0fb09 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:21:36.904818 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:36.981563 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:36.991893 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2af0af78-9e3a-49c5-8401-57869ee185e6 admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:21:37.000130 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-2af0af78-9e3a-49c5-8401-57869ee185e6 admin admin] 10.222.0.37 "PUT /v2.0/routers/3aa8420d-7378-4033-af1d-6dae369fd742/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6917481 Nov 08 16:21:37.000130 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 41718) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:37.003129 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bcb94f5-8877-45e6-a4f3-ab85cf709a0e None None] Sync routers for ids ['3aa8420d-7378-4033-af1d-6dae369fd742'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:21:37.009585 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f0c4ded0-3419-458b-ab12-da310a2b2fd7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b3094cea-72ef-41cf-ac88-a6d678f0fb09'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:21:37.012163 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ccc3d4f3-5b44-4c5c-87c0-f8aea8eff197" -d '{"events": [{"server_uuid": "f0c4ded0-3419-458b-ab12-da310a2b2fd7", "name": "network-vif-plugged", "status": "completed", "tag": "b3094cea-72ef-41cf-ac88-a6d678f0fb09"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:21:37.033550 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port b3094cea-72ef-41cf-ac88-a6d678f0fb09, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=b3094cea-72ef-41cf-ac88-a6d678f0fb09,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:21:37.038256 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bcb94f5-8877-45e6-a4f3-ab85cf709a0e None None] Routers {'3aa8420d-7378-4033-af1d-6dae369fd742'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:21:37.038888 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-7bcb94f5-8877-45e6-a4f3-ab85cf709a0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:21:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['3aa8420d-7378-4033-af1d-6dae369fd742'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:37.042567 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:37.042923 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 304e385a-c4e3-48f0-8723-230b5da69dc3 no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:21:37.079663 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:21:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-be5d7027-8f54-4a72-84f2-65a90bb0b3a5 x-openstack-request-id: req-be5d7027-8f54-4a72-84f2-65a90bb0b3a5 {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:21:37.079945 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f0c4ded0-3419-458b-ab12-da310a2b2fd7", "name": "network-vif-plugged", "status": "completed", "tag": "b3094cea-72ef-41cf-ac88-a6d678f0fb09", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:21:37.080191 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-be5d7027-8f54-4a72-84f2-65a90bb0b3a5 {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:21:37.080572 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f0c4ded0-3419-458b-ab12-da310a2b2fd7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b3094cea-72ef-41cf-ac88-a6d678f0fb09', 'code': 200} Nov 08 16:21:37.118517 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-74bbf56b-c265-440d-ad7c-e4e7bac2d8e4 admin admin] Publish callbacks [] for router, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:37.121749 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] No Port match for: 304e385a-c4e3-48f0-8723-230b5da69dc3 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:21:37.122105 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 304e385a-c4e3-48f0-8723-230b5da69dc3 not bound to the agent host hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:21:37.183276 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=b3094cea-72ef-41cf-ac88-a6d678f0fb09,revision_number=7']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:37.203966 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-7bcb94f5-8877-45e6-a4f3-ab85cf709a0e None None] Set router 3aa8420d-7378-4033-af1d-6dae369fd742 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:21:37.217548 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-74bbf56b-c265-440d-ad7c-e4e7bac2d8e4 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:37.271927 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-74bbf56b-c265-440d-ad7c-e4e7bac2d8e4 admin admin] Deleting port 67b0adb8-cf59-4b2f-9264-ca9da05f833f {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:21:37.272264 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-74bbf56b-c265-440d-ad7c-e4e7bac2d8e4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:37.347803 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [None req-74bbf56b-c265-440d-ad7c-e4e7bac2d8e4 admin admin] For port 67b0adb8-cf59-4b2f-9264-ca9da05f833f, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=67b0adb8-cf59-4b2f-9264-ca9da05f833f,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:21:37.348157 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-74bbf56b-c265-440d-ad7c-e4e7bac2d8e4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:37.360508 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-74bbf56b-c265-440d-ad7c-e4e7bac2d8e4 admin admin] Calling delete_port for 67b0adb8-cf59-4b2f-9264-ca9da05f833f owned by network:router_gateway {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:21:37.378660 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-7bcb94f5-8877-45e6-a4f3-ab85cf709a0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'name': 'tempest-TestMinimumBasicScenario-138746869-router', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148'}], 'enable_snat': True}, 'gw_port_id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:17:03Z', 'updated_at': '2021-11-08T16:21:36Z', 'revision_number': 5, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'gw_port': {'id': '67b0adb8-cf59-4b2f-9264-ca9da05f833f', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:1c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:04Z', 'updated_at': '2021-11-08T16:17:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:37.404251 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bcb94f5-8877-45e6-a4f3-ab85cf709a0e None None] Checking router: 3aa8420d-7378-4033-af1d-6dae369fd742 for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:21:37.412402 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bcb94f5-8877-45e6-a4f3-ab85cf709a0e None None] Routers {'3aa8420d-7378-4033-af1d-6dae369fd742'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:21:37.412998 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-7bcb94f5-8877-45e6-a4f3-ab85cf709a0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:21:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['3aa8420d-7378-4033-af1d-6dae369fd742'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:37.497244 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-7bcb94f5-8877-45e6-a4f3-ab85cf709a0e None None] Set router 3aa8420d-7378-4033-af1d-6dae369fd742 gateway port host: None {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:21:37.516893 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-74bbf56b-c265-440d-ad7c-e4e7bac2d8e4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:37.543072 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74bbf56b-c265-440d-ad7c-e4e7bac2d8e4 admin admin] Pushing event deleted for resources: {'Port': ['ID=67b0adb8-cf59-4b2f-9264-ca9da05f833f,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:37.551297 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-7bcb94f5-8877-45e6-a4f3-ab85cf709a0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'name': 'tempest-TestMinimumBasicScenario-138746869-router', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:17:03Z', 'updated_at': '2021-11-08T16:21:37Z', 'revision_number': 6, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'gw_port_host': None}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:37.577383 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bcb94f5-8877-45e6-a4f3-ab85cf709a0e None None] The sync data for ids ['3aa8420d-7378-4033-af1d-6dae369fd742'] in dv-cinder-816187-2-iscsi is: [{'id': '3aa8420d-7378-4033-af1d-6dae369fd742', 'name': 'tempest-TestMinimumBasicScenario-138746869-router', 'tenant_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:17:03Z', 'updated_at': '2021-11-08T16:21:37Z', 'revision_number': 6, 'project_id': '9ad6e5c060034b2ca263bfdcb07fe807', 'gw_port_host': None}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:21:37.609125 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-74bbf56b-c265-440d-ad7c-e4e7bac2d8e4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-2032325'] for router_gateway, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:37.710145 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-74bbf56b-c265-440d-ad7c-e4e7bac2d8e4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-2034023', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-12866'] for router, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:37.712255 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-74bbf56b-c265-440d-ad7c-e4e7bac2d8e4 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:37.774870 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-74bbf56b-c265-440d-ad7c-e4e7bac2d8e4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-2034044'] for router, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:37.775434 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-74bbf56b-c265-440d-ad7c-e4e7bac2d8e4 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3aa8420d-7378-4033-af1d-6dae369fd742 {{(pid=101244) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 08 16:21:37.780316 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-74bbf56b-c265-440d-ad7c-e4e7bac2d8e4 admin admin] Publish callbacks [] for router, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:37.781451 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-74bbf56b-c265-440d-ad7c-e4e7bac2d8e4 admin admin] 10.222.0.37 "DELETE /v2.0/routers/3aa8420d-7378-4033-af1d-6dae369fd742 HTTP/1.1" status: 204 len: 168 time: 0.7810388 Nov 08 16:21:37.784971 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 41722) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:37.827283 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_v2 [None req-f443010d-0792-41f5-a5d4-5e70fd109ede admin admin] Deleting subnet 12999abd-2828-4905-aed0-938c2f27aed8 {{(pid=101244) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 16:21:37.830236 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f443010d-0792-41f5-a5d4-5e70fd109ede admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:37.865287 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f443010d-0792-41f5-a5d4-5e70fd109ede admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8047127'] for subnet, precommit_delete_associations {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:38.011096 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f443010d-0792-41f5-a5d4-5e70fd109ede admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-872226'] for subnet, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:38.020234 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f792511f-3d3b-4e6e-a581-fcd7780f4e01 req-a7d83b9f-4c36-4983-85ad-8d671a78d855 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:38.021824 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f792511f-3d3b-4e6e-a581-fcd7780f4e01 req-a7d83b9f-4c36-4983-85ad-8d671a78d855 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.1171200 Nov 08 16:21:38.101813 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f792511f-3d3b-4e6e-a581-fcd7780f4e01 req-d8033ce5-fd66-433d-8080-ebd8cf7c69e5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0625274 Nov 08 16:21:38.106348 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f443010d-0792-41f5-a5d4-5e70fd109ede admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-872235', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4227786', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4279947'] for subnet, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:38.127648 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-01cfb60a-06ff-4b6c-bfad-b1df3f00b5ba None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:38.134827 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f443010d-0792-41f5-a5d4-5e70fd109ede admin admin] Pushing event deleted for resources: {'Subnet': ['ID=12999abd-2828-4905-aed0-938c2f27aed8,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:38.145900 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f443010d-0792-41f5-a5d4-5e70fd109ede admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for subnet, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:38.149744 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-f443010d-0792-41f5-a5d4-5e70fd109ede admin admin] 10.222.0.37 "DELETE /v2.0/subnets/12999abd-2828-4905-aed0-938c2f27aed8 HTTP/1.1" status: 204 len: 168 time: 0.3636539 Nov 08 16:21:38.150618 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-052c4d67-4c46-42d9-b8fe-9cc4ebdf5727 None None] Network 52eb1d65-dc7c-45c5-9521-97cb18715837 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:21:38.152083 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 41728) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:38.216699 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7adbbfc7-5ab5-4d63-9bd4-279218a4ca1b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1007047'] for network, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:38.269456 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-7adbbfc7-5ab5-4d63-9bd4-279218a4ca1b admin admin] Deleting port ecf3fe3f-6f7d-43cd-a052-e875b1cc1232 {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:21:38.269887 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7adbbfc7-5ab5-4d63-9bd4-279218a4ca1b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:38.333809 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [None req-7adbbfc7-5ab5-4d63-9bd4-279218a4ca1b admin admin] For port ecf3fe3f-6f7d-43cd-a052-e875b1cc1232, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=ecf3fe3f-6f7d-43cd-a052-e875b1cc1232,segment=NetworkSegment(1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3),segment_id=1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:21:38.334169 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7adbbfc7-5ab5-4d63-9bd4-279218a4ca1b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:38.350267 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-7adbbfc7-5ab5-4d63-9bd4-279218a4ca1b admin admin] Calling delete_port for ecf3fe3f-6f7d-43cd-a052-e875b1cc1232 owned by network:dhcp {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:21:38.382466 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d7e80b8-3770-4565-a301-eee9ffec8714 None None] DHCP port deletion for 52eb1d65-dc7c-45c5-9521-97cb18715837 request from dv-cinder-816187-2-iscsi {{(pid=101246) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 08 16:21:38.429933 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-4d7e80b8-3770-4565-a301-eee9ffec8714 None None] Deleting port ecf3fe3f-6f7d-43cd-a052-e875b1cc1232 {{(pid=101246) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:21:38.430377 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-4d7e80b8-3770-4565-a301-eee9ffec8714 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:38.432703 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7adbbfc7-5ab5-4d63-9bd4-279218a4ca1b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:38.461872 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7adbbfc7-5ab5-4d63-9bd4-279218a4ca1b admin admin] Pushing event deleted for resources: {'Port': ['ID=ecf3fe3f-6f7d-43cd-a052-e875b1cc1232,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:38.465313 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7adbbfc7-5ab5-4d63-9bd4-279218a4ca1b admin admin] No DVR routers for this DVR port ecf3fe3f-6f7d-43cd-a052-e875b1cc1232 on host dv-cinder-816187-2-iscsi {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:21:38.496007 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-4d7e80b8-3770-4565-a301-eee9ffec8714 None None] For port ecf3fe3f-6f7d-43cd-a052-e875b1cc1232, host dv-cinder-816187-2-iscsi, got binding levels [] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:21:38.496542 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-4d7e80b8-3770-4565-a301-eee9ffec8714 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:38.510928 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-4d7e80b8-3770-4565-a301-eee9ffec8714 None None] Calling delete_port for ecf3fe3f-6f7d-43cd-a052-e875b1cc1232 owned by network:dhcp {{(pid=101246) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:21:38.514965 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.ipam_backend_mixin [None req-4d7e80b8-3770-4565-a301-eee9ffec8714 None None] Port ecf3fe3f-6f7d-43cd-a052-e875b1cc1232 was not found and therefore no delete operation was performed {{(pid=101246) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 08 16:21:38.516233 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-4d7e80b8-3770-4565-a301-eee9ffec8714 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364'] for port, after_delete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:38.533313 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7adbbfc7-5ab5-4d63-9bd4-279218a4ca1b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-869719', 'neutron.services.segments.db._delete_segments_for_network-8792877333297'] for network, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:38.542004 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d7e80b8-3770-4565-a301-eee9ffec8714 None None] Pushing event deleted for resources: {'Port': ['ID=ecf3fe3f-6f7d-43cd-a052-e875b1cc1232,revision_number=None']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:38.543914 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d7e80b8-3770-4565-a301-eee9ffec8714 None None] No DVR routers for this DVR port ecf3fe3f-6f7d-43cd-a052-e875b1cc1232 on host dv-cinder-816187-2-iscsi {{(pid=101246) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:21:38.558138 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-7adbbfc7-5ab5-4d63-9bd4-279218a4ca1b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['52eb1d65-dc7c-45c5-9521-97cb18715837']}} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:38.569524 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-7adbbfc7-5ab5-4d63-9bd4-279218a4ca1b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3') {'for_net_delete': True} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:38.569915 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-7adbbfc7-5ab5-4d63-9bd4-279218a4ca1b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1af325f5-89d4-4ec7-a9d3-7bcdc1d46af3') {} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:38.579873 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7adbbfc7-5ab5-4d63-9bd4-279218a4ca1b admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792877333818', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8047118'] for segment, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:38.594935 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7adbbfc7-5ab5-4d63-9bd4-279218a4ca1b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:38.601421 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7adbbfc7-5ab5-4d63-9bd4-279218a4ca1b admin admin] Releasing vlan 179 on physical network physnet1 to pool {{(pid=101244) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 16:21:38.602015 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7adbbfc7-5ab5-4d63-9bd4-279218a4ca1b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4227628'] for segment, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: Traceback (most recent call last): Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: timer() Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: cb(*args, **kw) Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: return func(*args, **kwargs) Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: self._notify() Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: self.callback(batched_events) Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: event.method(event) Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: return f(self, *a, **k) Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: return self._get(url).json() Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: return self.request(url, 'GET', **kwargs) Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 16:21:38.603997 dv-cinder-816187-2-iscsi neutron-server[101244]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 16:21:38.662919 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7adbbfc7-5ab5-4d63-9bd4-279218a4ca1b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-868772', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-2032313'] for network, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:38.667605 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7adbbfc7-5ab5-4d63-9bd4-279218a4ca1b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:38.671549 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-7adbbfc7-5ab5-4d63-9bd4-279218a4ca1b admin admin] 10.222.0.37 "DELETE /v2.0/networks/52eb1d65-dc7c-45c5-9521-97cb18715837 HTTP/1.1" status: 204 len: 168 time: 0.5186987 Nov 08 16:21:38.675670 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 41730) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:38.684060 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7adbbfc7-5ab5-4d63-9bd4-279218a4ca1b admin admin] Pushing event deleted for resources: {'Network': ['ID=52eb1d65-dc7c-45c5-9521-97cb18715837,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:39.272895 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7adcd33e-c919-45a6-9154-67025f698fb5 req-6aef5585-b91e-4314-bca3-e426daaad6d9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:39.274449 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7adcd33e-c919-45a6-9154-67025f698fb5 req-6aef5585-b91e-4314-bca3-e426daaad6d9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.0706584 Nov 08 16:21:39.338656 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7adcd33e-c919-45a6-9154-67025f698fb5 req-261400c8-3c1b-407d-a66e-2de29f26db85 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0573471 Nov 08 16:21:39.399245 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-229e5285-769c-465d-8f92-0a32675bd95c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-2033295'] for router_interface, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:39.669068 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 1530a0fe-3181-4905-89a0-9606e9ca5a5f no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:21:39.705048 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: 1530a0fe-3181-4905-89a0-9606e9ca5a5f {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:21:39.706556 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 1530a0fe-3181-4905-89a0-9606e9ca5a5f not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:21:39.707756 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device ecf3fe3f-6f7d-43cd-a052-e875b1cc1232 no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:21:39.732800 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-229e5285-769c-465d-8f92-0a32675bd95c admin admin] Deleting port 63b9282d-3815-4e8c-b7d3-6fa7280c68ed {{(pid=101245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:21:39.733447 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-229e5285-769c-465d-8f92-0a32675bd95c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:39.749374 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: ecf3fe3f-6f7d-43cd-a052-e875b1cc1232 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:21:39.749823 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device ecf3fe3f-6f7d-43cd-a052-e875b1cc1232 not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:21:39.750308 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 67b0adb8-cf59-4b2f-9264-ca9da05f833f no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:21:39.774511 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: 67b0adb8-cf59-4b2f-9264-ca9da05f833f {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:21:39.774952 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 67b0adb8-cf59-4b2f-9264-ca9da05f833f not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:21:39.829018 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [None req-229e5285-769c-465d-8f92-0a32675bd95c admin admin] For port 63b9282d-3815-4e8c-b7d3-6fa7280c68ed, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=63b9282d-3815-4e8c-b7d3-6fa7280c68ed,segment=NetworkSegment(d39e409c-0d63-45bc-961f-deac71fbc480),segment_id=d39e409c-0d63-45bc-961f-deac71fbc480)] {{(pid=101245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:21:39.829538 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-229e5285-769c-465d-8f92-0a32675bd95c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:39.845185 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-229e5285-769c-465d-8f92-0a32675bd95c admin admin] Calling delete_port for 63b9282d-3815-4e8c-b7d3-6fa7280c68ed owned by network:router_interface {{(pid=101245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:21:40.061095 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-229e5285-769c-465d-8f92-0a32675bd95c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:40.120385 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-229e5285-769c-465d-8f92-0a32675bd95c admin admin] Pushing event deleted for resources: {'Port': ['ID=63b9282d-3815-4e8c-b7d3-6fa7280c68ed,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:40.317268 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-229e5285-769c-465d-8f92-0a32675bd95c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1599532', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-2034495'] for router_interface, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:40.502177 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a45dc6bc-7a65-4413-b71e-d81b5d5b5ba0 req-8287dabc-e73b-4a23-ac9b-ee6eb6096603 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:40.504230 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a45dc6bc-7a65-4413-b71e-d81b5d5b5ba0 req-8287dabc-e73b-4a23-ac9b-ee6eb6096603 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.0756557 Nov 08 16:21:40.566809 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a45dc6bc-7a65-4413-b71e-d81b5d5b5ba0 req-5b2c6f81-22f3-4cf4-b840-9e46e7e0c51c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0520380 Nov 08 16:21:40.570974 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-229e5285-769c-465d-8f92-0a32675bd95c admin admin] Router 73e4d323-f5da-4144-a58e-cc999a357e1a has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101245) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:21:40.607121 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-f76b356b-c93a-4406-a37b-1d90c2bc5ab6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:40.713550 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-229e5285-769c-465d-8f92-0a32675bd95c admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101245) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:21:40.721941 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-229e5285-769c-465d-8f92-0a32675bd95c admin admin] 10.222.0.37 "PUT /v2.0/routers/73e4d323-f5da-4144-a58e-cc999a357e1a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0425007 Nov 08 16:21:40.722344 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 41762) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:40.727476 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86f8298c-b078-4617-8941-1f364f3bcaf8 None None] Sync routers for ids ['73e4d323-f5da-4144-a58e-cc999a357e1a'] in dv-cinder-816187-2-iscsi {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:21:40.741630 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86f8298c-b078-4617-8941-1f364f3bcaf8 None None] Routers {'73e4d323-f5da-4144-a58e-cc999a357e1a'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:21:40.742384 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-86f8298c-b078-4617-8941-1f364f3bcaf8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:21:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['73e4d323-f5da-4144-a58e-cc999a357e1a'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:40.848813 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-86f8298c-b078-4617-8941-1f364f3bcaf8 None None] Set router 73e4d323-f5da-4144-a58e-cc999a357e1a gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:21:40.855727 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1df527d1-3a80-446a-bcae-9a7169e834b2 admin admin] Publish callbacks [] for router, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:40.978342 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1df527d1-3a80-446a-bcae-9a7169e834b2 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:41.035696 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-86f8298c-b078-4617-8941-1f364f3bcaf8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73e4d323-f5da-4144-a58e-cc999a357e1a', 'name': 'tempest-TestMinimumBasicScenario-292743942-router', 'tenant_id': '9aa725833c2f4f209193bd189d5e5828', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.233'}], 'enable_snat': True}, 'gw_port_id': '479982ae-a3e6-4c3a-bef4-83d36603ee76', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:17:10Z', 'updated_at': '2021-11-08T16:21:39Z', 'revision_number': 5, 'project_id': '9aa725833c2f4f209193bd189d5e5828', 'gw_port': {'id': '479982ae-a3e6-4c3a-bef4-83d36603ee76', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:10:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73e4d323-f5da-4144-a58e-cc999a357e1a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 495, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:17:10Z', 'updated_at': '2021-11-08T16:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:41.045844 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-1df527d1-3a80-446a-bcae-9a7169e834b2 admin admin] Deleting port 479982ae-a3e6-4c3a-bef4-83d36603ee76 {{(pid=101245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:21:41.046361 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1df527d1-3a80-446a-bcae-9a7169e834b2 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:41.066190 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86f8298c-b078-4617-8941-1f364f3bcaf8 None None] Checking router: 73e4d323-f5da-4144-a58e-cc999a357e1a for host: dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:21:41.074628 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86f8298c-b078-4617-8941-1f364f3bcaf8 None None] Routers {'73e4d323-f5da-4144-a58e-cc999a357e1a'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:21:41.075232 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-86f8298c-b078-4617-8941-1f364f3bcaf8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:21:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['73e4d323-f5da-4144-a58e-cc999a357e1a'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:41.150070 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [None req-1df527d1-3a80-446a-bcae-9a7169e834b2 admin admin] For port 479982ae-a3e6-4c3a-bef4-83d36603ee76, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=479982ae-a3e6-4c3a-bef4-83d36603ee76,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:21:41.150513 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1df527d1-3a80-446a-bcae-9a7169e834b2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:41.167479 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-1df527d1-3a80-446a-bcae-9a7169e834b2 admin admin] Calling delete_port for 479982ae-a3e6-4c3a-bef4-83d36603ee76 owned by network:router_gateway {{(pid=101245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:21:41.174393 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-86f8298c-b078-4617-8941-1f364f3bcaf8 None None] Set router 73e4d323-f5da-4144-a58e-cc999a357e1a gateway port host: None {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:21:41.246027 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-86f8298c-b078-4617-8941-1f364f3bcaf8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73e4d323-f5da-4144-a58e-cc999a357e1a', 'name': 'tempest-TestMinimumBasicScenario-292743942-router', 'tenant_id': '9aa725833c2f4f209193bd189d5e5828', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:17:10Z', 'updated_at': '2021-11-08T16:21:40Z', 'revision_number': 6, 'project_id': '9aa725833c2f4f209193bd189d5e5828', 'gw_port_host': None}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:41.283258 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86f8298c-b078-4617-8941-1f364f3bcaf8 None None] The sync data for ids ['73e4d323-f5da-4144-a58e-cc999a357e1a'] in dv-cinder-816187-2-iscsi is: [{'id': '73e4d323-f5da-4144-a58e-cc999a357e1a', 'name': 'tempest-TestMinimumBasicScenario-292743942-router', 'tenant_id': '9aa725833c2f4f209193bd189d5e5828', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:17:10Z', 'updated_at': '2021-11-08T16:21:40Z', 'revision_number': 6, 'project_id': '9aa725833c2f4f209193bd189d5e5828', 'gw_port_host': None}] {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:21:41.364266 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1df527d1-3a80-446a-bcae-9a7169e834b2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:41.390678 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1df527d1-3a80-446a-bcae-9a7169e834b2 admin admin] Pushing event deleted for resources: {'Port': ['ID=479982ae-a3e6-4c3a-bef4-83d36603ee76,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:41.469572 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1df527d1-3a80-446a-bcae-9a7169e834b2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-2032325'] for router_gateway, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:41.560151 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:41.599869 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1df527d1-3a80-446a-bcae-9a7169e834b2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-2034023', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-12866'] for router, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:41.603322 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1df527d1-3a80-446a-bcae-9a7169e834b2 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:41.687864 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1df527d1-3a80-446a-bcae-9a7169e834b2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-2034044'] for router, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:41.688478 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1df527d1-3a80-446a-bcae-9a7169e834b2 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 73e4d323-f5da-4144-a58e-cc999a357e1a {{(pid=101245) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 08 16:21:41.718476 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1df527d1-3a80-446a-bcae-9a7169e834b2 admin admin] Publish callbacks [] for router, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:41.719439 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-1df527d1-3a80-446a-bcae-9a7169e834b2 admin admin] 10.222.0.37 "DELETE /v2.0/routers/73e4d323-f5da-4144-a58e-cc999a357e1a HTTP/1.1" status: 204 len: 168 time: 0.9962273 Nov 08 16:21:41.726228 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 41770) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:41.728528 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcf9f945-74f3-42fc-89ab-93d897884e9c req-cdcd3bd7-12ce-47d9-ab34-6090d657d417 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:41.730971 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dcf9f945-74f3-42fc-89ab-93d897884e9c req-cdcd3bd7-12ce-47d9-ab34-6090d657d417 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.0826554 Nov 08 16:21:41.808839 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dcf9f945-74f3-42fc-89ab-93d897884e9c req-1714cdaa-eba0-457a-a5eb-85d1f2a73018 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0675519 Nov 08 16:21:41.838869 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_v2 [None req-a7d9d7a6-7219-443e-822e-20f4f6e2349d admin admin] Deleting subnet ec9f5754-7287-4a31-83db-39c7eedbf104 {{(pid=101245) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 16:21:41.842990 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a7d9d7a6-7219-443e-822e-20f4f6e2349d admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:41.870893 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 63b9282d-3815-4e8c-b7d3-6fa7280c68ed no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:21:41.886465 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a7d9d7a6-7219-443e-822e-20f4f6e2349d admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5113603'] for subnet, precommit_delete_associations {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:41.893204 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: 63b9282d-3815-4e8c-b7d3-6fa7280c68ed {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:21:41.893625 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 63b9282d-3815-4e8c-b7d3-6fa7280c68ed not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:21:42.008529 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a7d9d7a6-7219-443e-822e-20f4f6e2349d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-872226'] for subnet, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:42.069692 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a7d9d7a6-7219-443e-822e-20f4f6e2349d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-872235', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7464090', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6098572'] for subnet, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:42.102778 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7d9d7a6-7219-443e-822e-20f4f6e2349d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ec9f5754-7287-4a31-83db-39c7eedbf104,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:42.113351 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a7d9d7a6-7219-443e-822e-20f4f6e2349d admin admin] Publish callbacks [] for subnet, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:42.113351 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-a7d9d7a6-7219-443e-822e-20f4f6e2349d admin admin] 10.222.0.37 "DELETE /v2.0/subnets/ec9f5754-7287-4a31-83db-39c7eedbf104 HTTP/1.1" status: 204 len: 168 time: 0.3827057 Nov 08 16:21:42.113532 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 41772) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:42.117014 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9090ce0c-a078-4267-a63e-2940849e6e6c None None] Network 4147c9ec-e793-4b9d-9d14-0919c75accc6 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:21:42.217770 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-917434d7-5813-48b1-ab2d-72c4c6227b1a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1007047'] for network, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:42.289297 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-917434d7-5813-48b1-ab2d-72c4c6227b1a admin admin] Deleting port 975890f9-d242-4fbe-b5b7-8cc9601fb0d6 {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:21:42.289641 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-917434d7-5813-48b1-ab2d-72c4c6227b1a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:42.365362 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [None req-917434d7-5813-48b1-ab2d-72c4c6227b1a admin admin] For port 975890f9-d242-4fbe-b5b7-8cc9601fb0d6, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=975890f9-d242-4fbe-b5b7-8cc9601fb0d6,segment=NetworkSegment(d39e409c-0d63-45bc-961f-deac71fbc480),segment_id=d39e409c-0d63-45bc-961f-deac71fbc480)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:21:42.365874 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-917434d7-5813-48b1-ab2d-72c4c6227b1a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:42.390659 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-917434d7-5813-48b1-ab2d-72c4c6227b1a admin admin] Calling delete_port for 975890f9-d242-4fbe-b5b7-8cc9601fb0d6 owned by network:dhcp {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:21:42.490452 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-797f1680-b6b5-451c-ae74-bdbadfa1d4bb None None] DHCP port deletion for 4147c9ec-e793-4b9d-9d14-0919c75accc6 request from dv-cinder-816187-2-iscsi {{(pid=101246) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 08 16:21:42.593793 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-797f1680-b6b5-451c-ae74-bdbadfa1d4bb None None] Deleting port 975890f9-d242-4fbe-b5b7-8cc9601fb0d6 {{(pid=101246) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:21:42.594488 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-797f1680-b6b5-451c-ae74-bdbadfa1d4bb None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:42.727446 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-797f1680-b6b5-451c-ae74-bdbadfa1d4bb None None] For port 975890f9-d242-4fbe-b5b7-8cc9601fb0d6, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=975890f9-d242-4fbe-b5b7-8cc9601fb0d6,segment=NetworkSegment(d39e409c-0d63-45bc-961f-deac71fbc480),segment_id=d39e409c-0d63-45bc-961f-deac71fbc480)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:21:42.727446 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-797f1680-b6b5-451c-ae74-bdbadfa1d4bb None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:42.742905 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-797f1680-b6b5-451c-ae74-bdbadfa1d4bb None None] Calling delete_port for 975890f9-d242-4fbe-b5b7-8cc9601fb0d6 owned by network:dhcp {{(pid=101246) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:21:42.783705 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-917434d7-5813-48b1-ab2d-72c4c6227b1a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:42.812427 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-917434d7-5813-48b1-ab2d-72c4c6227b1a admin admin] Pushing event deleted for resources: {'Port': ['ID=975890f9-d242-4fbe-b5b7-8cc9601fb0d6,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:42.818731 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-917434d7-5813-48b1-ab2d-72c4c6227b1a admin admin] No DVR routers for this DVR port 975890f9-d242-4fbe-b5b7-8cc9601fb0d6 on host dv-cinder-816187-2-iscsi {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:21:42.906113 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-797f1680-b6b5-451c-ae74-bdbadfa1d4bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364'] for port, after_delete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:42.941268 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-797f1680-b6b5-451c-ae74-bdbadfa1d4bb None None] Pushing event deleted for resources: {'Port': ['ID=975890f9-d242-4fbe-b5b7-8cc9601fb0d6,revision_number=None']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:42.945012 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-797f1680-b6b5-451c-ae74-bdbadfa1d4bb None None] No DVR routers for this DVR port 975890f9-d242-4fbe-b5b7-8cc9601fb0d6 on host dv-cinder-816187-2-iscsi {{(pid=101246) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:21:43.000486 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-917434d7-5813-48b1-ab2d-72c4c6227b1a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-869719', 'neutron.services.segments.db._delete_segments_for_network-8792877333297'] for network, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:43.027913 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-917434d7-5813-48b1-ab2d-72c4c6227b1a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4147c9ec-e793-4b9d-9d14-0919c75accc6']}} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:43.040652 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-917434d7-5813-48b1-ab2d-72c4c6227b1a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd39e409c-0d63-45bc-961f-deac71fbc480') {'for_net_delete': True} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:43.041001 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-917434d7-5813-48b1-ab2d-72c4c6227b1a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd39e409c-0d63-45bc-961f-deac71fbc480') {} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:43.055524 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c62a63-e4cb-4b23-a4a5-265b651b64b8 req-75607ca2-a108-4cda-a350-2bbf5bf8ae42 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:43.057075 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-95c62a63-e4cb-4b23-a4a5-265b651b64b8 req-75607ca2-a108-4cda-a350-2bbf5bf8ae42 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.0972412 Nov 08 16:21:43.062143 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-917434d7-5813-48b1-ab2d-72c4c6227b1a admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792877333818', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8047118'] for segment, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:43.092864 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-917434d7-5813-48b1-ab2d-72c4c6227b1a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:43.101601 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-917434d7-5813-48b1-ab2d-72c4c6227b1a admin admin] Releasing vlan 172 on physical network physnet1 to pool {{(pid=101244) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 16:21:43.102038 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-917434d7-5813-48b1-ab2d-72c4c6227b1a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4227628'] for segment, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: Traceback (most recent call last): Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: timer() Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: cb(*args, **kw) Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: return func(*args, **kwargs) Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: self._notify() Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: self.callback(batched_events) Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: event.method(event) Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: return f(self, *a, **k) Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: return self._get(url).json() Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: return self.request(url, 'GET', **kwargs) Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 16:21:43.103775 dv-cinder-816187-2-iscsi neutron-server[101244]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 16:21:43.179304 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-95c62a63-e4cb-4b23-a4a5-265b651b64b8 req-14c5f7c8-fce5-497e-8726-6b54f0c1aa48 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1054633 Nov 08 16:21:43.185746 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-917434d7-5813-48b1-ab2d-72c4c6227b1a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-868772', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-2032313'] for network, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:43.193355 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-917434d7-5813-48b1-ab2d-72c4c6227b1a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:43.196704 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-917434d7-5813-48b1-ab2d-72c4c6227b1a admin admin] 10.222.0.37 "DELETE /v2.0/networks/4147c9ec-e793-4b9d-9d14-0919c75accc6 HTTP/1.1" status: 204 len: 168 time: 1.0823696 Nov 08 16:21:43.217640 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-917434d7-5813-48b1-ab2d-72c4c6227b1a admin admin] Pushing event deleted for resources: {'Network': ['ID=4147c9ec-e793-4b9d-9d14-0919c75accc6,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:43.295384 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:43.421685 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 41786) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:43.473973 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-e2564bda-ef84-4dba-8314-99a7c08aa2b5 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=9ad6e5c060034b2ca263bfdcb07fe807&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0509474 Nov 08 16:21:43.476328 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 41788) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:43.531661 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-900b0a25-d68e-47c9-bc9a-b52f2b6546ab admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:43.554680 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-900b0a25-d68e-47c9-bc9a-b52f2b6546ab admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:43.606050 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-900b0a25-d68e-47c9-bc9a-b52f2b6546ab admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:43.608807 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-900b0a25-d68e-47c9-bc9a-b52f2b6546ab admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:43.612474 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-900b0a25-d68e-47c9-bc9a-b52f2b6546ab admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/1d0afe5a-015d-4e87-a876-479fff7e7b28 HTTP/1.1" status: 204 len: 168 time: 0.1341491 Nov 08 16:21:43.628456 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-900b0a25-d68e-47c9-bc9a-b52f2b6546ab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1d0afe5a-015d-4e87-a876-479fff7e7b28,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:43.671123 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 479982ae-a3e6-4c3a-bef4-83d36603ee76 no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:21:43.696878 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: 479982ae-a3e6-4c3a-bef4-83d36603ee76 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:21:43.697513 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 479982ae-a3e6-4c3a-bef4-83d36603ee76 not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:21:43.698122 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 975890f9-d242-4fbe-b5b7-8cc9601fb0d6 no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:21:43.718215 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: 975890f9-d242-4fbe-b5b7-8cc9601fb0d6 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:21:43.718837 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 975890f9-d242-4fbe-b5b7-8cc9601fb0d6 not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:21:43.976097 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:44.011626 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 41794) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:44.058752 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-25ab342a-00fd-4fbc-8459-e89f73457802 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=9aa725833c2f4f209193bd189d5e5828&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0459354 Nov 08 16:21:44.061933 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 41796) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:44.121322 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5762be07-f31a-47fd-9d73-bd5d0cdf17da admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:44.143900 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5762be07-f31a-47fd-9d73-bd5d0cdf17da admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:44.203005 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5762be07-f31a-47fd-9d73-bd5d0cdf17da admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:44.205979 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5762be07-f31a-47fd-9d73-bd5d0cdf17da admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:44.207781 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-5762be07-f31a-47fd-9d73-bd5d0cdf17da admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/fdcb0b25-d45a-4090-8db2-02384b3cda03 HTTP/1.1" status: 204 len: 168 time: 0.1435504 Nov 08 16:21:44.216551 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5762be07-f31a-47fd-9d73-bd5d0cdf17da admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fdcb0b25-d45a-4090-8db2-02384b3cda03,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:44.333044 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6fe2fba-923e-4d40-ae8d-0eddcc64a54b req-053ee03c-097a-4b71-886f-2a4c712700d4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:44.342393 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e6fe2fba-923e-4d40-ae8d-0eddcc64a54b req-053ee03c-097a-4b71-886f-2a4c712700d4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.0667067 Nov 08 16:21:44.394595 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e6fe2fba-923e-4d40-ae8d-0eddcc64a54b req-65f1a305-a731-48e9-a234-6872a943a11e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0512657 Nov 08 16:21:45.007537 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 41822) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:45.114024 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-08e66dc2-90de-4f1f-b902-39b9a97227b1 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1067069244-network', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:21:45.136040 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-08e66dc2-90de-4f1f-b902-39b9a97227b1 admin admin] Made reservation on behalf of 71b067e1fbac491a8e16a4ba91049db9 for: {'network': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:21:45.138578 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-08e66dc2-90de-4f1f-b902-39b9a97227b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for network, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:45.148786 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-08e66dc2-90de-4f1f-b902-39b9a97227b1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:45.225331 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-08e66dc2-90de-4f1f-b902-39b9a97227b1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:45.230045 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-08e66dc2-90de-4f1f-b902-39b9a97227b1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:45.251499 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-08e66dc2-90de-4f1f-b902-39b9a97227b1 admin admin] vlan segment allocate from pool success with {'vlan_id': 190, 'physical_network': 'physnet1'} {{(pid=101244) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 16:21:45.267473 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08e66dc2-90de-4f1f-b902-39b9a97227b1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=90c49503-72c6-42ed-a78a-abf10c8bd51f,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:45.270620 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-08e66dc2-90de-4f1f-b902-39b9a97227b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:45.270963 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.db.segments_db [None req-08e66dc2-90de-4f1f-b902-39b9a97227b1 admin admin] Added segment d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c of type vlan for network f9b0f22e-a782-44ad-bfe0-8de1f795305e Nov 08 16:21:45.312965 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-08e66dc2-90de-4f1f-b902-39b9a97227b1 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792876766172'] for network, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:45.341959 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-08e66dc2-90de-4f1f-b902-39b9a97227b1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for network, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:45.342994 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-08e66dc2-90de-4f1f-b902-39b9a97227b1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:45.343660 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-08e66dc2-90de-4f1f-b902-39b9a97227b1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:45.400341 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-08e66dc2-90de-4f1f-b902-39b9a97227b1 admin admin] 10.222.0.37 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.3916686 Nov 08 16:21:45.403054 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 41826) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:45.409431 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-ab6bb3bd-0e64-4880-91c0-b672946726ff admin admin] Request body: {'subnet': {'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1067069244-subnet', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'ip_version': 4}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:21:45.425680 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08e66dc2-90de-4f1f-b902-39b9a97227b1 admin admin] Pushing event updated for resources: {'Network': ['ID=f9b0f22e-a782-44ad-bfe0-8de1f795305e,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:45.437348 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Network f9b0f22e-a782-44ad-bfe0-8de1f795305e details requested by agent ovs-agent-dv-cinder-816187-2-iscsi with host dv-cinder-816187-2-iscsi {{(pid=101246) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 16:21:45.442195 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ab6bb3bd-0e64-4880-91c0-b672946726ff admin admin] Made reservation on behalf of 71b067e1fbac491a8e16a4ba91049db9 for: {'subnet': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:21:45.445137 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-ab6bb3bd-0e64-4880-91c0-b672946726ff admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4280170'] for subnet, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:45.585941 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55d4e5b1-08c0-4c55-9a8a-f9fb3ef18144 req-3e7cf117-bbcc-449d-b410-f7c1d0205bcb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:45.589815 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-55d4e5b1-08c0-4c55-9a8a-f9fb3ef18144 req-3e7cf117-bbcc-449d-b410-f7c1d0205bcb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.0699208 Nov 08 16:21:45.708219 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-55d4e5b1-08c0-4c55-9a8a-f9fb3ef18144 req-e3afdbef-5349-43ce-8075-781ac8961547 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1091599 Nov 08 16:21:45.733664 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-ab6bb3bd-0e64-4880-91c0-b672946726ff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-4227723', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4279952'] for subnet, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:45.804188 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab6bb3bd-0e64-4880-91c0-b672946726ff admin admin] Pushing event updated for resources: {'Subnet': ['ID=67fc8ce5-82b1-4d6d-bf54-e59b246e08c9,revision_number=0']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:45.812244 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab6bb3bd-0e64-4880-91c0-b672946726ff admin admin] Checking segment: {'id': 'd3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:21:45.812599 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab6bb3bd-0e64-4880-91c0-b672946726ff admin admin] Network hostable DHCP agents. Network: f9b0f22e-a782-44ad-bfe0-8de1f795305e, hostable agents: ['a7e1e7ee-1ce2-474e-9688-58f0884991a4'], hosted agents: [] {{(pid=101244) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 16:21:45.838255 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab6bb3bd-0e64-4880-91c0-b672946726ff admin admin] Network f9b0f22e-a782-44ad-bfe0-8de1f795305e is scheduled to be hosted by DHCP agent a7e1e7ee-1ce2-474e-9688-58f0884991a4 with binding_index 1 {{(pid=101244) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 16:21:45.885673 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-ab6bb3bd-0e64-4880-91c0-b672946726ff admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816187-2-iscsi, f9b0f22e-a782-44ad-bfe0-8de1f795305e) {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:21:45.890132 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab6bb3bd-0e64-4880-91c0-b672946726ff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:45.890985 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-ab6bb3bd-0e64-4880-91c0-b672946726ff admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for subnet, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:45.896628 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed65f316-8f72-4c8a-bc90-6d51f3604227 None None] Network f9b0f22e-a782-44ad-bfe0-8de1f795305e requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:21:45.912139 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-ab6bb3bd-0e64-4880-91c0-b672946726ff admin admin] 10.222.0.37 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.5055163 Nov 08 16:21:45.912372 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 41832) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:45.916462 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-9fb0c77a-2f9a-4297-92c7-4d251979f0df admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1067069244-router', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:21:45.946110 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9fb0c77a-2f9a-4297-92c7-4d251979f0df admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-2034701', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-12912'] for router, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:45.947332 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9fb0c77a-2f9a-4297-92c7-4d251979f0df admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-2034873', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-2032180', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-2080911', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-12873'] for router, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:46.015566 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9fb0c77a-2f9a-4297-92c7-4d251979f0df admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:46.066450 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4b78b27f-3b05-45a5-a1ab-190df09a72b8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp66bc375f-c06b-591f-b467-1ee6ff0ebcc7-f9b0f22e-a782-44ad-bfe0-8de1f795305e', 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'fixed_ips': [{'subnet_id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9'}]}} from dv-cinder-816187-2-iscsi. {{(pid=101246) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 08 16:21:46.067316 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-4b78b27f-3b05-45a5-a1ab-190df09a72b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:46.195993 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9fb0c77a-2f9a-4297-92c7-4d251979f0df admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:46.216910 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.db_base_plugin_common [None req-4b78b27f-3b05-45a5-a1ab-190df09a72b8 None None] Allocated IP 172.20.0.2 (f9b0f22e-a782-44ad-bfe0-8de1f795305e/67fc8ce5-82b1-4d6d-bf54-e59b246e08c9/4dc08b68-9f5b-47a8-a7bd-ea939e5ade06) {{(pid=101246) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:21:46.392002 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-4b78b27f-3b05-45a5-a1ab-190df09a72b8 None None] Publish callbacks [] for port, precommit_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:46.400166 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-4b78b27f-3b05-45a5-a1ab-190df09a72b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:46.442004 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b78b27f-3b05-45a5-a1ab-190df09a72b8 None None] Network f9b0f22e-a782-44ad-bfe0-8de1f795305e is already hosted by enough agents. {{(pid=101246) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:21:46.448966 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.scheduler.base_scheduler [None req-4b78b27f-3b05-45a5-a1ab-190df09a72b8 None None] Resources bound (agent type, host, resource id): {{(pid=101246) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:21:46.450273 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9fb0c77a-2f9a-4297-92c7-4d251979f0df admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:46.452255 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b78b27f-3b05-45a5-a1ab-190df09a72b8 None None] Received port after_create {{(pid=101246) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:21:46.474005 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9fb0c77a-2f9a-4297-92c7-4d251979f0df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:46.485307 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b78b27f-3b05-45a5-a1ab-190df09a72b8 None None] Pushing event updated for resources: {'Port': ['ID=4dc08b68-9f5b-47a8-a7bd-ea939e5ade06,revision_number=1']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:46.520796 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-4b78b27f-3b05-45a5-a1ab-190df09a72b8 None None] Attempting to bind port 4dc08b68-9f5b-47a8-a7bd-ea939e5ade06 on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:21:46.521741 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-4b78b27f-3b05-45a5-a1ab-190df09a72b8 None None] Attempting to bind port 4dc08b68-9f5b-47a8-a7bd-ea939e5ade06 by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': 'd3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e'}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:21:46.521741 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b78b27f-3b05-45a5-a1ab-190df09a72b8 None None] Attempting to bind port 4dc08b68-9f5b-47a8-a7bd-ea939e5ade06 on network f9b0f22e-a782-44ad-bfe0-8de1f795305e {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:21:46.529693 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b78b27f-3b05-45a5-a1ab-190df09a72b8 None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 21, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:21:46.530265 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b78b27f-3b05-45a5-a1ab-190df09a72b8 None None] Checking segment: {'id': 'd3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:21:46.530774 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-4b78b27f-3b05-45a5-a1ab-190df09a72b8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:46.531265 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b78b27f-3b05-45a5-a1ab-190df09a72b8 None None] Bound using segment: {'id': 'd3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e'} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:21:46.531841 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-4b78b27f-3b05-45a5-a1ab-190df09a72b8 None None] Bound port: 4dc08b68-9f5b-47a8-a7bd-ea939e5ade06, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e'}}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:21:46.532423 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-4b78b27f-3b05-45a5-a1ab-190df09a72b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:46.598329 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [None req-9fb0c77a-2f9a-4297-92c7-4d251979f0df admin admin] Allocated IP 172.27.3.52 (68f46265-b42a-49a0-8d57-f9362045cd9b/4728e4be-5a19-43c0-89cf-ced2a190645d/2e4e6d54-cd26-44b6-b7d7-25a59483eff0) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:21:46.620204 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-4b78b27f-3b05-45a5-a1ab-190df09a72b8 None None] For port 4dc08b68-9f5b-47a8-a7bd-ea939e5ade06, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:21:46.623660 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-4b78b27f-3b05-45a5-a1ab-190df09a72b8 None None] For port 4dc08b68-9f5b-47a8-a7bd-ea939e5ade06, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=4dc08b68-9f5b-47a8-a7bd-ea939e5ade06,segment=NetworkSegment(d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c),segment_id=d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c)] {{(pid=101246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:21:46.630769 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-4b78b27f-3b05-45a5-a1ab-190df09a72b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:46.696559 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b78b27f-3b05-45a5-a1ab-190df09a72b8 None None] Pushing event updated for resources: {'Port': ['ID=4dc08b68-9f5b-47a8-a7bd-ea939e5ade06,revision_number=2']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:46.793960 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9fb0c77a-2f9a-4297-92c7-4d251979f0df admin admin] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:46.886774 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9fb0c77a-2f9a-4297-92c7-4d251979f0df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:46.939966 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74d131c6-6eae-41bb-9cc9-1434de842cca req-50397092-5b40-40f0-aaac-6b06c361be4c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:46.941597 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-74d131c6-6eae-41bb-9cc9-1434de842cca req-50397092-5b40-40f0-aaac-6b06c361be4c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.1065826 Nov 08 16:21:46.943639 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9fb0c77a-2f9a-4297-92c7-4d251979f0df admin admin] Network 68f46265-b42a-49a0-8d57-f9362045cd9b is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:21:46.946830 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [None req-9fb0c77a-2f9a-4297-92c7-4d251979f0df admin admin] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:21:46.961425 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9fb0c77a-2f9a-4297-92c7-4d251979f0df admin admin] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:21:47.038508 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fb0c77a-2f9a-4297-92c7-4d251979f0df admin admin] Pushing event updated for resources: {'Port': ['ID=2e4e6d54-cd26-44b6-b7d7-25a59483eff0,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:47.093073 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-74d131c6-6eae-41bb-9cc9-1434de842cca req-8a291318-ad7c-4ec3-a5f9-f8604d95840d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1331859 Nov 08 16:21:47.326795 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9fb0c77a-2f9a-4297-92c7-4d251979f0df admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:47.542012 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9fb0c77a-2f9a-4297-92c7-4d251979f0df admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-2034870', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-2032353'] for router, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:47.617856 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:21:47.731439 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9fb0c77a-2f9a-4297-92c7-4d251979f0df admin admin] Router 775c558e-eb61-4b1c-80f7-d59df2812bdc is scheduled to L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f with binding_index 1 {{(pid=101244) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 08 16:21:47.760039 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 4dc08b68-9f5b-47a8-a7bd-ea939e5ade06 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:21:47.816332 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 4dc08b68-9f5b-47a8-a7bd-ea939e5ade06 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:21:47.816791 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:47.922700 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:47.923590 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9fb0c77a-2f9a-4297-92c7-4d251979f0df admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:21:47.961067 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] Sync routers for ids ['775c558e-eb61-4b1c-80f7-d59df2812bdc'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:21:47.964296 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9fb0c77a-2f9a-4297-92c7-4d251979f0df admin admin] Publish callbacks [] for router, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:47.969107 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 41844) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:47.970189 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-9fb0c77a-2f9a-4297-92c7-4d251979f0df admin admin] 10.222.0.37 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 2.0561349 Nov 08 16:21:48.035430 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] Routers {'775c558e-eb61-4b1c-80f7-d59df2812bdc'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:21:48.036973 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:21:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['775c558e-eb61-4b1c-80f7-d59df2812bdc'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:48.039387 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ea6c833-e758-43b5-8ce3-15560d7e7533 None None] Network f9b0f22e-a782-44ad-bfe0-8de1f795305e requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:21:48.190734 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] For port 4dc08b68-9f5b-47a8-a7bd-ea939e5ade06, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=4dc08b68-9f5b-47a8-a7bd-ea939e5ade06,segment=NetworkSegment(d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c),segment_id=d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:21:48.195650 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:48.230997 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-d51fee4a-82a2-4882-982f-e7ff025270be None None] Provisioning complete for port 4dc08b68-9f5b-47a8-a7bd-ea939e5ade06 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:21:48.231622 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-d51fee4a-82a2-4882-982f-e7ff025270be None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:48.273038 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:48.323429 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c67b4252-cb38-4e9c-9a8a-a87a6582f8bd req-2ba73431-b9db-45bc-96ab-77c6f8ce72bf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:48.325833 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c67b4252-cb38-4e9c-9a8a-a87a6582f8bd req-2ba73431-b9db-45bc-96ab-77c6f8ce72bf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.1020854 Nov 08 16:21:48.405963 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c67b4252-cb38-4e9c-9a8a-a87a6582f8bd req-8db9be8a-9b5a-47de-a186-2913abda3690 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0716155 Nov 08 16:21:48.449444 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] Set router 775c558e-eb61-4b1c-80f7-d59df2812bdc gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:21:48.732593 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-cf6442f5-353e-4eba-ac36-2d4970ccc7f5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:48.769348 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Pushing event updated for resources: {'Port': ['ID=4dc08b68-9f5b-47a8-a7bd-ea939e5ade06,revision_number=3']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:48.907364 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'name': 'tempest-TestShelveInstance-1067069244-router', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52'}], 'enable_snat': True}, 'gw_port_id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:21:45Z', 'updated_at': '2021-11-08T16:21:47Z', 'revision_number': 3, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'gw_port': {'id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:5b:f0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 566, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:46Z', 'updated_at': '2021-11-08T16:21:46Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:48.921769 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_common [None req-cf6442f5-353e-4eba-ac36-2d4970ccc7f5 admin admin] Allocated IP 172.20.0.1 (f9b0f22e-a782-44ad-bfe0-8de1f795305e/67fc8ce5-82b1-4d6d-bf54-e59b246e08c9/3a14a839-f3ee-4231-a9b5-00067b56ef01) {{(pid=101245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:21:48.941113 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] Checking router: 775c558e-eb61-4b1c-80f7-d59df2812bdc for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:21:48.941684 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] Updating router 775c558e-eb61-4b1c-80f7-d59df2812bdc port 2e4e6d54-cd26-44b6-b7d7-25a59483eff0 binding host dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 16:21:48.998561 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:49.056654 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-cf6442f5-353e-4eba-ac36-2d4970ccc7f5 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:49.123436 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-cf6442f5-353e-4eba-ac36-2d4970ccc7f5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:49.187523 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf6442f5-353e-4eba-ac36-2d4970ccc7f5 admin admin] Network f9b0f22e-a782-44ad-bfe0-8de1f795305e is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:21:49.196760 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-cf6442f5-353e-4eba-ac36-2d4970ccc7f5 admin admin] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:21:49.214975 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf6442f5-353e-4eba-ac36-2d4970ccc7f5 admin admin] Pushing event updated for resources: {'Port': ['ID=3a14a839-f3ee-4231-a9b5-00067b56ef01,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:49.217495 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf6442f5-353e-4eba-ac36-2d4970ccc7f5 admin admin] Received port after_create {{(pid=101245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:21:49.263795 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-cf6442f5-353e-4eba-ac36-2d4970ccc7f5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-2033204'] for router_interface, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:49.323703 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-a12bd9d0-3be9-4eb9-bf00-15b1829be6f8 None None] Provisioning complete for port 4dc08b68-9f5b-47a8-a7bd-ea939e5ade06 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:21:49.324079 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-a12bd9d0-3be9-4eb9-bf00-15b1829be6f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:49.425123 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-cf6442f5-353e-4eba-ac36-2d4970ccc7f5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:49.516159 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] Publish callbacks [] for port, precommit_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:49.554767 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:49.627850 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70f2ee74-66bd-4af0-9f04-62e078803b8e None None] Pushing event updated for resources: {'Port': ['ID=2e4e6d54-cd26-44b6-b7d7-25a59483eff0,revision_number=2']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:49.630236 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] Attempting to bind port 2e4e6d54-cd26-44b6-b7d7-25a59483eff0 on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:21:49.630656 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] Attempting to bind port 2e4e6d54-cd26-44b6-b7d7-25a59483eff0 by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:21:49.630936 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] Attempting to bind port 2e4e6d54-cd26-44b6-b7d7-25a59483eff0 on network 68f46265-b42a-49a0-8d57-f9362045cd9b {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:21:49.636988 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 21, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:21:49.637376 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] Checking segment: {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:21:49.637902 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:49.638286 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] Bound using segment: {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:21:49.638739 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] Bound port: 2e4e6d54-cd26-44b6-b7d7-25a59483eff0, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:21:49.639109 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:49.642453 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07da369d-5168-404b-a080-f725817b8b0b req-917aa4aa-fb1f-43d4-92d0-d5dc32d48880 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:49.646169 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-07da369d-5168-404b-a080-f725817b8b0b req-917aa4aa-fb1f-43d4-92d0-d5dc32d48880 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.0953374 Nov 08 16:21:49.651882 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-cf6442f5-353e-4eba-ac36-2d4970ccc7f5 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:49.676291 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-cf6442f5-353e-4eba-ac36-2d4970ccc7f5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7464016'] for port, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:49.711605 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-07da369d-5168-404b-a080-f725817b8b0b req-15037e3e-65df-4eb0-b443-09e71ddc9e5e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0615191 Nov 08 16:21:49.732149 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 4dc08b68-9f5b-47a8-a7bd-ea939e5ade06 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:21:49.750862 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf6442f5-353e-4eba-ac36-2d4970ccc7f5 admin admin] Pushing event updated for resources: {'Port': ['ID=3a14a839-f3ee-4231-a9b5-00067b56ef01,revision_number=2']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:49.775352 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-cf6442f5-353e-4eba-ac36-2d4970ccc7f5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1599525', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-2033312'] for router_interface, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:49.776837 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-0036af4f-63b4-4634-b7f1-1b1d08adf86e None None] Provisioning complete for port 3a14a839-f3ee-4231-a9b5-00067b56ef01 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:21:49.777334 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-0036af4f-63b4-4634-b7f1-1b1d08adf86e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:49.820185 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] For port 2e4e6d54-cd26-44b6-b7d7-25a59483eff0, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:21:49.845309 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-0036af4f-63b4-4634-b7f1-1b1d08adf86e None None] Port 3a14a839-f3ee-4231-a9b5-00067b56ef01 cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:21:49.850527 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] For port 2e4e6d54-cd26-44b6-b7d7-25a59483eff0, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=2e4e6d54-cd26-44b6-b7d7-25a59483eff0,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:21:49.858552 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:49.860535 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 4dc08b68-9f5b-47a8-a7bd-ea939e5ade06 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:21:49.861181 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:49.895996 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf6442f5-353e-4eba-ac36-2d4970ccc7f5 admin admin] Network f9b0f22e-a782-44ad-bfe0-8de1f795305e is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:21:49.897841 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-cf6442f5-353e-4eba-ac36-2d4970ccc7f5 admin admin] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:21:49.965858 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] Routers {'775c558e-eb61-4b1c-80f7-d59df2812bdc'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:21:49.966476 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:21:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['775c558e-eb61-4b1c-80f7-d59df2812bdc'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:49.972671 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70f2ee74-66bd-4af0-9f04-62e078803b8e None None] Pushing event updated for resources: {'Port': ['ID=2e4e6d54-cd26-44b6-b7d7-25a59483eff0,revision_number=3']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:50.045134 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cf6442f5-353e-4eba-ac36-2d4970ccc7f5 admin admin] Router 775c558e-eb61-4b1c-80f7-d59df2812bdc has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101245) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:21:50.172736 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] Set router 775c558e-eb61-4b1c-80f7-d59df2812bdc gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:21:50.207151 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cf6442f5-353e-4eba-ac36-2d4970ccc7f5 admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101245) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:21:50.229055 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-cf6442f5-353e-4eba-ac36-2d4970ccc7f5 admin admin] 10.222.0.37 "PUT /v2.0/routers/775c558e-eb61-4b1c-80f7-d59df2812bdc/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2588153 Nov 08 16:21:50.357146 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-b01bcd1a-07ff-4f5c-86ff-52446d0f28e2 None None] Provisioning complete for port 3a14a839-f3ee-4231-a9b5-00067b56ef01 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:21:50.357680 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-b01bcd1a-07ff-4f5c-86ff-52446d0f28e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:50.416614 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-b01bcd1a-07ff-4f5c-86ff-52446d0f28e2 None None] Port 3a14a839-f3ee-4231-a9b5-00067b56ef01 cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:21:50.485088 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'name': 'tempest-TestShelveInstance-1067069244-router', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52'}], 'enable_snat': True}, 'gw_port_id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:21:45Z', 'updated_at': '2021-11-08T16:21:49Z', 'revision_number': 4, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'gw_port': {'id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:5b:f0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 566, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:46Z', 'updated_at': '2021-11-08T16:21:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '3a14a839-f3ee-4231-a9b5-00067b56ef01', 'name': '', 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'mac_address': 'fa:16:3e:94:f9:91', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'device_owner': 'network:router_interface', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:48Z', 'updated_at': '2021-11-08T16:21:49Z', 'revision_number': 2, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'subnets': [{'id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:50.514402 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-baa22c95-503f-4c10-9c94-4ab52f0e325d None None] The sync data for ids ['775c558e-eb61-4b1c-80f7-d59df2812bdc'] in dv-cinder-816187-2-iscsi is: [{'id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'name': 'tempest-TestShelveInstance-1067069244-router', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52'}], 'enable_snat': True}, 'gw_port_id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:21:45Z', 'updated_at': '2021-11-08T16:21:49Z', 'revision_number': 4, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'gw_port': {'id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:5b:f0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 566, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:46Z', 'updated_at': '2021-11-08T16:21:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '3a14a839-f3ee-4231-a9b5-00067b56ef01', 'name': '', 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'mac_address': 'fa:16:3e:94:f9:91', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'device_owner': 'network:router_interface', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:48Z', 'updated_at': '2021-11-08T16:21:49Z', 'revision_number': 2, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'subnets': [{'id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:21:50.841013 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 41886) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:50.846579 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-603565d6-cba9-4236-a0f7-c9a349d7a3a7 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-632815821-network', 'tenant_id': '9bc7b00c5fe3471e84c0e2acaaa7d008'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:21:50.867593 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca240e0e-c405-48eb-93ac-4a3a5ebed996 req-fa097b04-f2c7-4316-8572-74465bc8ee4c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:50.869938 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ca240e0e-c405-48eb-93ac-4a3a5ebed996 req-fa097b04-f2c7-4316-8572-74465bc8ee4c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.0593927 Nov 08 16:21:50.871760 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-603565d6-cba9-4236-a0f7-c9a349d7a3a7 admin admin] Made reservation on behalf of 9bc7b00c5fe3471e84c0e2acaaa7d008 for: {'network': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:21:50.875000 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-603565d6-cba9-4236-a0f7-c9a349d7a3a7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for network, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:50.887524 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-603565d6-cba9-4236-a0f7-c9a349d7a3a7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:50.922012 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ca240e0e-c405-48eb-93ac-4a3a5ebed996 req-4687325d-640f-4d57-a859-7a5b5d63472b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445523 Nov 08 16:21:50.982702 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-603565d6-cba9-4236-a0f7-c9a349d7a3a7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:50.986692 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-603565d6-cba9-4236-a0f7-c9a349d7a3a7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:51.012207 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-603565d6-cba9-4236-a0f7-c9a349d7a3a7 admin admin] vlan segment allocate from pool success with {'vlan_id': 168, 'physical_network': 'physnet1'} {{(pid=101245) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 16:21:51.021567 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-603565d6-cba9-4236-a0f7-c9a349d7a3a7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=396b269c-b60c-499e-93f5-39ca50f7e9e2,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:51.027804 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-603565d6-cba9-4236-a0f7-c9a349d7a3a7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:51.028164 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.db.segments_db [None req-603565d6-cba9-4236-a0f7-c9a349d7a3a7 admin admin] Added segment 10cf7f40-17b2-437d-b05e-09a41ffbf808 of type vlan for network 5a75ccbd-4f9f-4f1a-b9e5-4921f028e916 Nov 08 16:21:51.070002 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-603565d6-cba9-4236-a0f7-c9a349d7a3a7 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792876766172'] for network, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:51.097077 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-603565d6-cba9-4236-a0f7-c9a349d7a3a7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703'] for network, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:51.098088 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-603565d6-cba9-4236-a0f7-c9a349d7a3a7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:51.098685 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-603565d6-cba9-4236-a0f7-c9a349d7a3a7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:51.164075 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-603565d6-cba9-4236-a0f7-c9a349d7a3a7 admin admin] 10.222.0.37 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.3217630 Nov 08 16:21:51.166699 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 41888) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:51.171388 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-8a873f1e-adee-4d8f-9c05-48e37ae51f7e admin admin] Request body: {'subnet': {'network_id': '5a75ccbd-4f9f-4f1a-b9e5-4921f028e916', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-632815821-subnet', 'tenant_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'ip_version': 4}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:21:51.181642 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-603565d6-cba9-4236-a0f7-c9a349d7a3a7 admin admin] Pushing event updated for resources: {'Network': ['ID=5a75ccbd-4f9f-4f1a-b9e5-4921f028e916,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:51.192216 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Network 5a75ccbd-4f9f-4f1a-b9e5-4921f028e916 details requested by agent ovs-agent-dv-cinder-816187-2-iscsi with host dv-cinder-816187-2-iscsi {{(pid=101246) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 16:21:51.200527 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8a873f1e-adee-4d8f-9c05-48e37ae51f7e admin admin] Made reservation on behalf of 9bc7b00c5fe3471e84c0e2acaaa7d008 for: {'subnet': 1} {{(pid=101245) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:21:51.204773 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-8a873f1e-adee-4d8f-9c05-48e37ae51f7e admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-6098797'] for subnet, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:51.397427 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-8a873f1e-adee-4d8f-9c05-48e37ae51f7e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7464155', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-6098583'] for subnet, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:51.464851 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a873f1e-adee-4d8f-9c05-48e37ae51f7e admin admin] Pushing event updated for resources: {'Subnet': ['ID=4b234dcd-085a-48b7-8b98-50c1a76e059b,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:51.470013 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a873f1e-adee-4d8f-9c05-48e37ae51f7e admin admin] Checking segment: {'id': '10cf7f40-17b2-437d-b05e-09a41ffbf808', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 168, 'network_id': '5a75ccbd-4f9f-4f1a-b9e5-4921f028e916'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:21:51.470368 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a873f1e-adee-4d8f-9c05-48e37ae51f7e admin admin] Network hostable DHCP agents. Network: 5a75ccbd-4f9f-4f1a-b9e5-4921f028e916, hostable agents: ['a7e1e7ee-1ce2-474e-9688-58f0884991a4'], hosted agents: [] {{(pid=101245) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 16:21:51.488225 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a873f1e-adee-4d8f-9c05-48e37ae51f7e admin admin] Network 5a75ccbd-4f9f-4f1a-b9e5-4921f028e916 is scheduled to be hosted by DHCP agent a7e1e7ee-1ce2-474e-9688-58f0884991a4 with binding_index 1 {{(pid=101245) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 16:21:51.497906 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-8a873f1e-adee-4d8f-9c05-48e37ae51f7e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816187-2-iscsi, 5a75ccbd-4f9f-4f1a-b9e5-4921f028e916) {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:21:51.502019 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a873f1e-adee-4d8f-9c05-48e37ae51f7e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:51.502652 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-8a873f1e-adee-4d8f-9c05-48e37ae51f7e admin admin] Publish callbacks [] for subnet, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:51.506754 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f448c31-7acf-413f-bd36-1cce2bd3d5d4 None None] Network 5a75ccbd-4f9f-4f1a-b9e5-4921f028e916 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:21:51.521549 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-8a873f1e-adee-4d8f-9c05-48e37ae51f7e admin admin] 10.222.0.37 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.3538203 Nov 08 16:21:51.524684 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 41892) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:51.529344 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-e68eb50f-c86e-488a-9c04-9fa9a8cd17ae admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-632815821-router', 'tenant_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:21:51.551206 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e68eb50f-c86e-488a-9c04-9fa9a8cd17ae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-2034701', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-12912'] for router, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:51.552221 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e68eb50f-c86e-488a-9c04-9fa9a8cd17ae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-2034873', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-2032180', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-2080911', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-12873'] for router, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:51.608830 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e68eb50f-c86e-488a-9c04-9fa9a8cd17ae admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:51.678568 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28621d79-2ba5-4248-a2f0-939e70db18e4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp66bc375f-c06b-591f-b467-1ee6ff0ebcc7-5a75ccbd-4f9f-4f1a-b9e5-4921f028e916', 'network_id': '5a75ccbd-4f9f-4f1a-b9e5-4921f028e916', 'tenant_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'fixed_ips': [{'subnet_id': '4b234dcd-085a-48b7-8b98-50c1a76e059b'}]}} from dv-cinder-816187-2-iscsi. {{(pid=101246) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 08 16:21:51.679420 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-28621d79-2ba5-4248-a2f0-939e70db18e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:51.778083 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e68eb50f-c86e-488a-9c04-9fa9a8cd17ae admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:51.781267 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 2e4e6d54-cd26-44b6-b7d7-25a59483eff0 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:21:51.798190 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deed838f-892c-4a6c-a458-8aa582c206a0 req-421ae3b7-8b5b-4312-a3cb-d87085a81c8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:51.800886 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-deed838f-892c-4a6c-a458-8aa582c206a0 req-421ae3b7-8b5b-4312-a3cb-d87085a81c8d service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=10a4252a63bf480d93d2e9da15bb8efd&device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 1099 time: 0.0704849 Nov 08 16:21:51.889838 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 2e4e6d54-cd26-44b6-b7d7-25a59483eff0 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:21:51.890102 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:51.920054 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deed838f-892c-4a6c-a458-8aa582c206a0 req-de110b40-7397-443a-8aa2-bba5269b7039 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:51.921911 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-deed838f-892c-4a6c-a458-8aa582c206a0 req-de110b40-7397-443a-8aa2-bba5269b7039 service neutron] 10.222.0.25 "GET /v2.0/networks?id=e0e08679-82fe-47eb-90b6-49a1713fdaca HTTP/1.1" status: 200 len: 918 time: 0.1113369 Nov 08 16:21:52.022967 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-deed838f-892c-4a6c-a458-8aa582c206a0 req-f920d085-285a-448d-849f-a317b4e3edbd service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b3094cea-72ef-41cf-ac88-a6d678f0fb09 HTTP/1.1" status: 200 len: 1001 time: 0.0913169 Nov 08 16:21:52.035738 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e68eb50f-c86e-488a-9c04-9fa9a8cd17ae admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:52.046140 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.db_base_plugin_common [None req-28621d79-2ba5-4248-a2f0-939e70db18e4 None None] Allocated IP 172.20.0.2 (5a75ccbd-4f9f-4f1a-b9e5-4921f028e916/4b234dcd-085a-48b7-8b98-50c1a76e059b/952c8a89-737f-42cc-810f-a2185847289b) {{(pid=101246) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:21:52.060486 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e68eb50f-c86e-488a-9c04-9fa9a8cd17ae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:52.109120 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deed838f-892c-4a6c-a458-8aa582c206a0 req-5134ccd5-3b70-41aa-9436-5ee5a7044c4b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:52.110631 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-deed838f-892c-4a6c-a458-8aa582c206a0 req-5134ccd5-3b70-41aa-9436-5ee5a7044c4b service neutron] 10.222.0.25 "GET /v2.0/subnets?id=fc52ff8b-1692-487b-a0de-f6290e65d880 HTTP/1.1" status: 200 len: 856 time: 0.0740378 Nov 08 16:21:52.119215 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-953aa2ca-b0cb-43c2-9d4e-81fd3b8dafa2 req-8782ffa6-692a-4b4d-984c-9597a941d1ef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:52.120968 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-953aa2ca-b0cb-43c2-9d4e-81fd3b8dafa2 req-8782ffa6-692a-4b4d-984c-9597a941d1ef tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.0933514 Nov 08 16:21:52.184985 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_common [None req-e68eb50f-c86e-488a-9c04-9fa9a8cd17ae admin admin] Allocated IP 172.27.3.254 (68f46265-b42a-49a0-8d57-f9362045cd9b/4728e4be-5a19-43c0-89cf-ced2a190645d/2793bc35-fa22-41fb-bd57-390a71fb9687) {{(pid=101245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:21:52.195161 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deed838f-892c-4a6c-a458-8aa582c206a0 req-a015098a-7550-4b0b-8286-a082aaba9519 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:52.197040 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-deed838f-892c-4a6c-a458-8aa582c206a0 req-a015098a-7550-4b0b-8286-a082aaba9519 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=e0e08679-82fe-47eb-90b6-49a1713fdaca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0740352 Nov 08 16:21:52.200951 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-953aa2ca-b0cb-43c2-9d4e-81fd3b8dafa2 req-0725c72e-d3c5-4f2b-86b3-bbe568eb4f31 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0682547 Nov 08 16:21:52.203953 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:52.231283 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] For port 2e4e6d54-cd26-44b6-b7d7-25a59483eff0, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=2e4e6d54-cd26-44b6-b7d7-25a59483eff0,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:21:52.237633 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:52.308396 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-deed838f-892c-4a6c-a458-8aa582c206a0 req-d87619ef-aef0-4e59-836b-b846964a7e48 service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1015284 Nov 08 16:21:52.313191 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-28621d79-2ba5-4248-a2f0-939e70db18e4 None None] Publish callbacks [] for port, precommit_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:52.322841 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e68eb50f-c86e-488a-9c04-9fa9a8cd17ae admin admin] Publish callbacks [] for port, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:52.325094 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-28621d79-2ba5-4248-a2f0-939e70db18e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355'] for port, after_create {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:52.333008 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Pushing event updated for resources: {'Port': ['ID=2e4e6d54-cd26-44b6-b7d7-25a59483eff0,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:52.367579 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28621d79-2ba5-4248-a2f0-939e70db18e4 None None] Network 5a75ccbd-4f9f-4f1a-b9e5-4921f028e916 is already hosted by enough agents. {{(pid=101246) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:21:52.367936 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e68eb50f-c86e-488a-9c04-9fa9a8cd17ae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:52.372585 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.scheduler.base_scheduler [None req-28621d79-2ba5-4248-a2f0-939e70db18e4 None None] Resources bound (agent type, host, resource id): {{(pid=101246) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:21:52.375698 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28621d79-2ba5-4248-a2f0-939e70db18e4 None None] Received port after_create {{(pid=101246) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:21:52.392924 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28621d79-2ba5-4248-a2f0-939e70db18e4 None None] Pushing event updated for resources: {'Port': ['ID=952c8a89-737f-42cc-810f-a2185847289b,revision_number=1']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:52.407103 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-deed838f-892c-4a6c-a458-8aa582c206a0 req-8ee390d1-ee1f-45bf-b617-50e7ca66a23a service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0904438 Nov 08 16:21:52.416016 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e68eb50f-c86e-488a-9c04-9fa9a8cd17ae admin admin] Network 68f46265-b42a-49a0-8d57-f9362045cd9b is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:21:52.422424 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-e68eb50f-c86e-488a-9c04-9fa9a8cd17ae admin admin] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:21:52.425343 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e68eb50f-c86e-488a-9c04-9fa9a8cd17ae admin admin] Received port after_create {{(pid=101245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:21:52.428527 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e68eb50f-c86e-488a-9c04-9fa9a8cd17ae admin admin] Pushing event updated for resources: {'Port': ['ID=2793bc35-fa22-41fb-bd57-390a71fb9687,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:52.438817 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-28621d79-2ba5-4248-a2f0-939e70db18e4 None None] Attempting to bind port 952c8a89-737f-42cc-810f-a2185847289b on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:21:52.439181 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-28621d79-2ba5-4248-a2f0-939e70db18e4 None None] Attempting to bind port 952c8a89-737f-42cc-810f-a2185847289b by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': '10cf7f40-17b2-437d-b05e-09a41ffbf808', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 168, 'network_id': '5a75ccbd-4f9f-4f1a-b9e5-4921f028e916'}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:21:52.440187 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-28621d79-2ba5-4248-a2f0-939e70db18e4 None None] Attempting to bind port 952c8a89-737f-42cc-810f-a2185847289b on network 5a75ccbd-4f9f-4f1a-b9e5-4921f028e916 {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:21:52.445327 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-28621d79-2ba5-4248-a2f0-939e70db18e4 None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 21, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:21:52.445836 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-28621d79-2ba5-4248-a2f0-939e70db18e4 None None] Checking segment: {'id': '10cf7f40-17b2-437d-b05e-09a41ffbf808', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 168, 'network_id': '5a75ccbd-4f9f-4f1a-b9e5-4921f028e916'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:21:52.446230 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-28621d79-2ba5-4248-a2f0-939e70db18e4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:52.446609 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-28621d79-2ba5-4248-a2f0-939e70db18e4 None None] Bound using segment: {'id': '10cf7f40-17b2-437d-b05e-09a41ffbf808', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 168, 'network_id': '5a75ccbd-4f9f-4f1a-b9e5-4921f028e916'} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:21:52.447053 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-28621d79-2ba5-4248-a2f0-939e70db18e4 None None] Bound port: 952c8a89-737f-42cc-810f-a2185847289b, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10cf7f40-17b2-437d-b05e-09a41ffbf808', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 168, 'network_id': '5a75ccbd-4f9f-4f1a-b9e5-4921f028e916'}}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:21:52.447417 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-28621d79-2ba5-4248-a2f0-939e70db18e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:52.508985 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-28621d79-2ba5-4248-a2f0-939e70db18e4 None None] For port 952c8a89-737f-42cc-810f-a2185847289b, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:21:52.512646 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-28621d79-2ba5-4248-a2f0-939e70db18e4 None None] For port 952c8a89-737f-42cc-810f-a2185847289b, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=952c8a89-737f-42cc-810f-a2185847289b,segment=NetworkSegment(10cf7f40-17b2-437d-b05e-09a41ffbf808),segment_id=10cf7f40-17b2-437d-b05e-09a41ffbf808)] {{(pid=101246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:21:52.518107 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-28621d79-2ba5-4248-a2f0-939e70db18e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:52.601440 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28621d79-2ba5-4248-a2f0-939e70db18e4 None None] Pushing event updated for resources: {'Port': ['ID=952c8a89-737f-42cc-810f-a2185847289b,revision_number=2']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:52.698154 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e68eb50f-c86e-488a-9c04-9fa9a8cd17ae admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:52.880831 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] Sync routers for ids ['775c558e-eb61-4b1c-80f7-d59df2812bdc'] in dv-cinder-816187-2-iscsi {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:21:52.890795 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] Routers {'775c558e-eb61-4b1c-80f7-d59df2812bdc'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:21:52.891404 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:21:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['775c558e-eb61-4b1c-80f7-d59df2812bdc'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:52.909732 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e68eb50f-c86e-488a-9c04-9fa9a8cd17ae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-2034870', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-2032353'] for router, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:53.049373 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e68eb50f-c86e-488a-9c04-9fa9a8cd17ae admin admin] Router 2b283ba5-8550-4152-a1be-c8c7a628d94b is scheduled to L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f with binding_index 1 {{(pid=101245) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 08 16:21:53.087800 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] Set router 775c558e-eb61-4b1c-80f7-d59df2812bdc gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:21:53.153825 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e68eb50f-c86e-488a-9c04-9fa9a8cd17ae admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101245) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:21:53.163476 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] Sync routers for ids ['2b283ba5-8550-4152-a1be-c8c7a628d94b'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:21:53.175878 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e68eb50f-c86e-488a-9c04-9fa9a8cd17ae admin admin] Publish callbacks [] for router, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:53.176278 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] Routers {'2b283ba5-8550-4152-a1be-c8c7a628d94b'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:21:53.176959 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:21:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['2b283ba5-8550-4152-a1be-c8c7a628d94b'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:53.177462 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-e68eb50f-c86e-488a-9c04-9fa9a8cd17ae admin admin] 10.222.0.37 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 1.6518252 Nov 08 16:21:53.180079 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 41898) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:53.324251 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'name': 'tempest-TestShelveInstance-1067069244-router', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52'}], 'enable_snat': True}, 'gw_port_id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:21:45Z', 'updated_at': '2021-11-08T16:21:49Z', 'revision_number': 4, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'gw_port': {'id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:5b:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 566, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:46Z', 'updated_at': '2021-11-08T16:21:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '3a14a839-f3ee-4231-a9b5-00067b56ef01', 'name': '', 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'mac_address': 'fa:16:3e:94:f9:91', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'device_owner': 'network:router_interface', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:48Z', 'updated_at': '2021-11-08T16:21:49Z', 'revision_number': 2, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'subnets': [{'id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:53.377778 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] Set router 2b283ba5-8550-4152-a1be-c8c7a628d94b gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:21:53.400645 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] Checking router: 775c558e-eb61-4b1c-80f7-d59df2812bdc for host: dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:21:53.410216 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b191066-1890-4159-b58b-614cd8560d75 req-9ea32beb-302d-44f0-ad14-3e97af1f8786 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:53.411177 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] Updating router 775c558e-eb61-4b1c-80f7-d59df2812bdc port 3a14a839-f3ee-4231-a9b5-00067b56ef01 binding host dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 16:21:53.430314 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6b191066-1890-4159-b58b-614cd8560d75 req-9ea32beb-302d-44f0-ad14-3e97af1f8786 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.1055386 Nov 08 16:21:53.444616 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:53.519104 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6b191066-1890-4159-b58b-614cd8560d75 req-bbac6ae1-0a97-490b-8cfb-53987adb2007 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0877504 Nov 08 16:21:53.617896 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f254c24-de0e-4188-baa9-4e6789500702 None None] Network 5a75ccbd-4f9f-4f1a-b9e5-4921f028e916 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:21:53.708525 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-3fb1b61f-6cb5-4f2e-970d-101c51d70f90 None None] Provisioning complete for port 952c8a89-737f-42cc-810f-a2185847289b triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:21:53.708978 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-3fb1b61f-6cb5-4f2e-970d-101c51d70f90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:53.737287 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b283ba5-8550-4152-a1be-c8c7a628d94b', 'name': 'tempest-TestShelveInstance-632815821-router', 'tenant_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '2793bc35-fa22-41fb-bd57-390a71fb9687', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:21:51Z', 'updated_at': '2021-11-08T16:21:52Z', 'revision_number': 3, 'project_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'gw_port': {'id': '2793bc35-fa22-41fb-bd57-390a71fb9687', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:cf:21', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2b283ba5-8550-4152-a1be-c8c7a628d94b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 578, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:52Z', 'updated_at': '2021-11-08T16:21:52Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:53.789361 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] Checking router: 2b283ba5-8550-4152-a1be-c8c7a628d94b for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:21:53.792256 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] Updating router 2b283ba5-8550-4152-a1be-c8c7a628d94b port 2793bc35-fa22-41fb-bd57-390a71fb9687 binding host dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 16:21:53.836545 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 952c8a89-737f-42cc-810f-a2185847289b up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:21:53.859701 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] Publish callbacks [] for port, precommit_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:53.869145 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:53.871927 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:53.970048 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3a20ab3-c007-4574-8e5f-8e0b47e4b9fc None None] Pushing event updated for resources: {'Port': ['ID=3a14a839-f3ee-4231-a9b5-00067b56ef01,revision_number=3']} {{(pid=101247) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:53.971707 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4c3422be-18da-47aa-9bd9-b9213be9dcee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:53.995042 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3a20ab3-c007-4574-8e5f-8e0b47e4b9fc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:53.995418 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3a20ab3-c007-4574-8e5f-8e0b47e4b9fc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:53.995757 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3a20ab3-c007-4574-8e5f-8e0b47e4b9fc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:53.996086 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3a20ab3-c007-4574-8e5f-8e0b47e4b9fc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:53.996413 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3a20ab3-c007-4574-8e5f-8e0b47e4b9fc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:53.997236 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3a20ab3-c007-4574-8e5f-8e0b47e4b9fc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:53.997582 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3a20ab3-c007-4574-8e5f-8e0b47e4b9fc None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:53.997929 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3a20ab3-c007-4574-8e5f-8e0b47e4b9fc None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:53.998272 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3a20ab3-c007-4574-8e5f-8e0b47e4b9fc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:53.999418 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3a20ab3-c007-4574-8e5f-8e0b47e4b9fc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:53.999753 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3a20ab3-c007-4574-8e5f-8e0b47e4b9fc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:54.000077 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3a20ab3-c007-4574-8e5f-8e0b47e4b9fc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101247) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:21:54.019298 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] Attempting to bind port 3a14a839-f3ee-4231-a9b5-00067b56ef01 on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:21:54.019655 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] Attempting to bind port 3a14a839-f3ee-4231-a9b5-00067b56ef01 by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': 'd3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e'}] {{(pid=101247) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:21:54.020011 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] Attempting to bind port 3a14a839-f3ee-4231-a9b5-00067b56ef01 on network f9b0f22e-a782-44ad-bfe0-8de1f795305e {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:21:54.025193 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 21, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:21:54.025563 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] Checking segment: {'id': 'd3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101247) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:21:54.026274 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:54.026806 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] Bound using segment: {'id': 'd3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e'} {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:21:54.027270 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] Bound port: 3a14a839-f3ee-4231-a9b5-00067b56ef01, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e'}}] {{(pid=101247) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:21:54.027670 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:54.098363 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-3fb1b61f-6cb5-4f2e-970d-101c51d70f90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:54.103042 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 952c8a89-737f-42cc-810f-a2185847289b triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:21:54.103198 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:54.118068 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.db [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] For port 3a14a839-f3ee-4231-a9b5-00067b56ef01, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101247) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:21:54.122580 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.db [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] For port 3a14a839-f3ee-4231-a9b5-00067b56ef01, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=3a14a839-f3ee-4231-a9b5-00067b56ef01,segment=NetworkSegment(d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c),segment_id=d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c)] {{(pid=101247) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:21:54.128234 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:54.191618 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3a20ab3-c007-4574-8e5f-8e0b47e4b9fc None None] Pushing event updated for resources: {'Port': ['ID=3a14a839-f3ee-4231-a9b5-00067b56ef01,revision_number=4']} {{(pid=101247) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:54.194361 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] Routers {'775c558e-eb61-4b1c-80f7-d59df2812bdc'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:21:54.194964 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:21:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['775c558e-eb61-4b1c-80f7-d59df2812bdc'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:54.211414 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_common [None req-4c3422be-18da-47aa-9bd9-b9213be9dcee admin admin] Allocated IP 172.20.0.1 (5a75ccbd-4f9f-4f1a-b9e5-4921f028e916/4b234dcd-085a-48b7-8b98-50c1a76e059b/f2f60e0f-a89e-47cf-9555-ff4b78af6adb) {{(pid=101245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:21:54.250941 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-3fb1b61f-6cb5-4f2e-970d-101c51d70f90 None None] For port 952c8a89-737f-42cc-810f-a2185847289b, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=952c8a89-737f-42cc-810f-a2185847289b,segment=NetworkSegment(10cf7f40-17b2-437d-b05e-09a41ffbf808),segment_id=10cf7f40-17b2-437d-b05e-09a41ffbf808)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:21:54.263549 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-3fb1b61f-6cb5-4f2e-970d-101c51d70f90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:54.343094 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] Set router 775c558e-eb61-4b1c-80f7-d59df2812bdc gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:21:54.424702 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fb1b61f-6cb5-4f2e-970d-101c51d70f90 None None] Pushing event updated for resources: {'Port': ['ID=952c8a89-737f-42cc-810f-a2185847289b,revision_number=3']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:54.446053 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4c3422be-18da-47aa-9bd9-b9213be9dcee admin admin] Publish callbacks [] for port, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:54.456635 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 2e4e6d54-cd26-44b6-b7d7-25a59483eff0 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:21:54.493143 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4c3422be-18da-47aa-9bd9-b9213be9dcee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:54.513923 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-c7e4d721-43b3-4636-8e2f-dcae3547a549 None None] Provisioning complete for port 3a14a839-f3ee-4231-a9b5-00067b56ef01 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:21:54.514291 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-c7e4d721-43b3-4636-8e2f-dcae3547a549 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:54.546511 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c3422be-18da-47aa-9bd9-b9213be9dcee admin admin] Network 5a75ccbd-4f9f-4f1a-b9e5-4921f028e916 is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:21:54.550202 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-4c3422be-18da-47aa-9bd9-b9213be9dcee admin admin] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:21:54.553011 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c3422be-18da-47aa-9bd9-b9213be9dcee admin admin] Received port after_create {{(pid=101245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:21:54.575371 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] Publish callbacks [] for port, precommit_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:54.603093 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c3422be-18da-47aa-9bd9-b9213be9dcee admin admin] Pushing event updated for resources: {'Port': ['ID=f2f60e0f-a89e-47cf-9555-ff4b78af6adb,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:54.613228 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:54.623181 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4c3422be-18da-47aa-9bd9-b9213be9dcee admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-2033204'] for router_interface, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:54.632184 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'name': 'tempest-TestShelveInstance-1067069244-router', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52'}], 'enable_snat': True}, 'gw_port_id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:21:45Z', 'updated_at': '2021-11-08T16:21:49Z', 'revision_number': 4, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'gw_port': {'id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:5b:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 566, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:46Z', 'updated_at': '2021-11-08T16:21:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '3a14a839-f3ee-4231-a9b5-00067b56ef01', 'name': '', 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'mac_address': 'fa:16:3e:94:f9:91', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'device_owner': 'network:router_interface', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:48Z', 'updated_at': '2021-11-08T16:21:54Z', 'revision_number': 4, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'subnets': [{'id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:54.684215 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-20e1121b-b93d-41a1-bb8e-a18a6933d07e None None] The sync data for ids ['775c558e-eb61-4b1c-80f7-d59df2812bdc'] in dv-cinder-816187-2-iscsi is: [{'id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'name': 'tempest-TestShelveInstance-1067069244-router', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52'}], 'enable_snat': True}, 'gw_port_id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:21:45Z', 'updated_at': '2021-11-08T16:21:49Z', 'revision_number': 4, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'gw_port': {'id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:5b:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 566, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:46Z', 'updated_at': '2021-11-08T16:21:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '3a14a839-f3ee-4231-a9b5-00067b56ef01', 'name': '', 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'mac_address': 'fa:16:3e:94:f9:91', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'device_owner': 'network:router_interface', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:48Z', 'updated_at': '2021-11-08T16:21:54Z', 'revision_number': 4, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'subnets': [{'id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:21:54.750690 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74af4c17-9f9a-4a30-8de1-0123b4b90d94 req-5a62a78e-984d-48fa-83e6-0b5f5139f824 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:54.756607 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-74af4c17-9f9a-4a30-8de1-0123b4b90d94 req-5a62a78e-984d-48fa-83e6-0b5f5139f824 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 946 time: 0.1201141 Nov 08 16:21:54.845387 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4c3422be-18da-47aa-9bd9-b9213be9dcee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:54.852282 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-74af4c17-9f9a-4a30-8de1-0123b4b90d94 req-d01a22af-8cd8-4d10-8a04-0383d3c6eca4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0872626 Nov 08 16:21:54.917688 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c5189c7-dc0b-469d-a3e2-138e15b08545 None None] Pushing event updated for resources: {'Port': ['ID=2793bc35-fa22-41fb-bd57-390a71fb9687,revision_number=2']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:54.917848 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] Attempting to bind port 2793bc35-fa22-41fb-bd57-390a71fb9687 on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:21:54.918647 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] Attempting to bind port 2793bc35-fa22-41fb-bd57-390a71fb9687 by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:21:54.918647 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] Attempting to bind port 2793bc35-fa22-41fb-bd57-390a71fb9687 on network 68f46265-b42a-49a0-8d57-f9362045cd9b {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:21:54.961094 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-c7e4d721-43b3-4636-8e2f-dcae3547a549 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:54.963074 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device b3094cea-72ef-41cf-ac88-a6d678f0fb09 no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:21:54.976514 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 2e4e6d54-cd26-44b6-b7d7-25a59483eff0 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:21:54.976878 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:55.000929 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 21, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:21:55.002419 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] Checking segment: {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:21:55.002822 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:55.003249 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] Bound using segment: {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'} {{(pid=101246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:21:55.003733 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.managers [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] Bound port: 2793bc35-fa22-41fb-bd57-390a71fb9687, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5654fd20-eb76-4a3d-8fc2-e37f9aa812c4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b'}}] {{(pid=101246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:21:55.004102 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:55.088895 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4c3422be-18da-47aa-9bd9-b9213be9dcee admin admin] Publish callbacks [] for port, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:55.094042 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4c3422be-18da-47aa-9bd9-b9213be9dcee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7464016'] for port, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:55.119791 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-c7e4d721-43b3-4636-8e2f-dcae3547a549 None None] For port 3a14a839-f3ee-4231-a9b5-00067b56ef01, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=3a14a839-f3ee-4231-a9b5-00067b56ef01,segment=NetworkSegment(d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c),segment_id=d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:21:55.136063 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-c7e4d721-43b3-4636-8e2f-dcae3547a549 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:55.168925 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] For port 2793bc35-fa22-41fb-bd57-390a71fb9687, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:21:55.175913 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c3422be-18da-47aa-9bd9-b9213be9dcee admin admin] Pushing event updated for resources: {'Port': ['ID=f2f60e0f-a89e-47cf-9555-ff4b78af6adb,revision_number=2']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:55.178662 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4c3422be-18da-47aa-9bd9-b9213be9dcee admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1599525', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-2033312'] for router_interface, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:55.224203 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] For port 2793bc35-fa22-41fb-bd57-390a71fb9687, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=2793bc35-fa22-41fb-bd57-390a71fb9687,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:21:55.244187 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:55.283845 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7e4d721-43b3-4636-8e2f-dcae3547a549 None None] Pushing event updated for resources: {'Port': ['ID=3a14a839-f3ee-4231-a9b5-00067b56ef01,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:55.286466 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:55.293778 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c3422be-18da-47aa-9bd9-b9213be9dcee admin admin] Network 5a75ccbd-4f9f-4f1a-b9e5-4921f028e916 is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:21:55.295207 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-4c3422be-18da-47aa-9bd9-b9213be9dcee admin admin] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:21:55.390462 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f0c4ded0-3419-458b-ab12-da310a2b2fd7', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b3094cea-72ef-41cf-ac88-a6d678f0fb09'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:21:55.392253 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-04c05165-8aae-4192-9c13-9b0fd5341a09" -d '{"events": [{"server_uuid": "f0c4ded0-3419-458b-ab12-da310a2b2fd7", "name": "network-vif-unplugged", "status": "completed", "tag": "b3094cea-72ef-41cf-ac88-a6d678f0fb09"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:21:55.395033 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-5e61957b-257d-4d12-9a45-e9373a4e6d6b None None] Provisioning complete for port 952c8a89-737f-42cc-810f-a2185847289b triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:21:55.395395 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-5e61957b-257d-4d12-9a45-e9373a4e6d6b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:55.435405 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] Routers {'2b283ba5-8550-4152-a1be-c8c7a628d94b'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:21:55.436052 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:21:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['2b283ba5-8550-4152-a1be-c8c7a628d94b'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:55.462101 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port b3094cea-72ef-41cf-ac88-a6d678f0fb09, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=b3094cea-72ef-41cf-ac88-a6d678f0fb09,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:21:55.463909 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c5189c7-dc0b-469d-a3e2-138e15b08545 None None] Pushing event updated for resources: {'Port': ['ID=2793bc35-fa22-41fb-bd57-390a71fb9687,revision_number=3']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:55.501336 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4c3422be-18da-47aa-9bd9-b9213be9dcee admin admin] Router 2b283ba5-8550-4152-a1be-c8c7a628d94b has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101245) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:21:55.514183 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Mon, 08 Nov 2021 16:21:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5d962b65-baac-4043-8752-b6db79075e01 x-openstack-request-id: req-5d962b65-baac-4043-8752-b6db79075e01 {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:21:55.514498 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f0c4ded0-3419-458b-ab12-da310a2b2fd7", "name": "network-vif-unplugged", "status": "failed", "tag": "b3094cea-72ef-41cf-ac88-a6d678f0fb09", "code": 422}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:21:55.514735 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-5d962b65-baac-4043-8752-b6db79075e01 {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:21:55.515144 dv-cinder-816187-2-iscsi neutron-server[101246]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'f0c4ded0-3419-458b-ab12-da310a2b2fd7', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'b3094cea-72ef-41cf-ac88-a6d678f0fb09', 'code': 422} returned with failed status Nov 08 16:21:55.516203 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:55.641960 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=b3094cea-72ef-41cf-ac88-a6d678f0fb09,revision_number=8']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:55.699516 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] Set router 2b283ba5-8550-4152-a1be-c8c7a628d94b gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:21:55.701097 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4c3422be-18da-47aa-9bd9-b9213be9dcee admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101245) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:21:55.707751 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-4c3422be-18da-47aa-9bd9-b9213be9dcee admin admin] 10.222.0.37 "PUT /v2.0/routers/2b283ba5-8550-4152-a1be-c8c7a628d94b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5263853 Nov 08 16:21:55.764734 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-5e61957b-257d-4d12-9a45-e9373a4e6d6b None None] Provisioning complete for port 3a14a839-f3ee-4231-a9b5-00067b56ef01 triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:21:55.765180 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-5e61957b-257d-4d12-9a45-e9373a4e6d6b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:55.820454 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 952c8a89-737f-42cc-810f-a2185847289b up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:21:55.907515 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [req-a3432e46-f956-4844-acea-9f69e0f927b6 req-32351ba7-3b77-4884-bb1d-2285b798e322 service neutron] http://10.222.0.37:9696/v2.0/extensions returned with HTTP 200 {{(pid=101244) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 16:21:55.909496 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a3432e46-f956-4844-acea-9f69e0f927b6 req-32351ba7-3b77-4884-bb1d-2285b798e322 service neutron] 10.222.0.37 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0075717 Nov 08 16:21:56.011842 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 952c8a89-737f-42cc-810f-a2185847289b triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:21:56.012210 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:56.063581 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-5e61957b-257d-4d12-9a45-e9373a4e6d6b None None] Provisioning complete for port f2f60e0f-a89e-47cf-9555-ff4b78af6adb triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:21:56.063928 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-5e61957b-257d-4d12-9a45-e9373a4e6d6b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:56.118543 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-5e61957b-257d-4d12-9a45-e9373a4e6d6b None None] Port f2f60e0f-a89e-47cf-9555-ff4b78af6adb cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:21:56.171623 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b283ba5-8550-4152-a1be-c8c7a628d94b', 'name': 'tempest-TestShelveInstance-632815821-router', 'tenant_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '2793bc35-fa22-41fb-bd57-390a71fb9687', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:21:51Z', 'updated_at': '2021-11-08T16:21:54Z', 'revision_number': 4, 'project_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'gw_port': {'id': '2793bc35-fa22-41fb-bd57-390a71fb9687', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:cf:21', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2b283ba5-8550-4152-a1be-c8c7a628d94b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 578, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:52Z', 'updated_at': '2021-11-08T16:21:55Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': 'f2f60e0f-a89e-47cf-9555-ff4b78af6adb', 'name': '', 'network_id': '5a75ccbd-4f9f-4f1a-b9e5-4921f028e916', 'tenant_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'mac_address': 'fa:16:3e:60:97:d0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2b283ba5-8550-4152-a1be-c8c7a628d94b', 'device_owner': 'network:router_interface', 'standard_attr_id': 579, 'fixed_ips': [{'subnet_id': '4b234dcd-085a-48b7-8b98-50c1a76e059b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:53Z', 'updated_at': '2021-11-08T16:21:54Z', 'revision_number': 2, 'project_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'subnets': [{'id': '4b234dcd-085a-48b7-8b98-50c1a76e059b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:56.185931 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-710f343f-6033-4078-b5a4-0ba0d6a52fee req-d4715caf-c568-4816-8cb9-281c0d8c1e34 service neutron] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0745451 Nov 08 16:21:56.200421 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 3a14a839-f3ee-4231-a9b5-00067b56ef01 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:21:56.202362 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d044d69-ade7-48e6-a1cd-368372b59c30 None None] The sync data for ids ['2b283ba5-8550-4152-a1be-c8c7a628d94b'] in dv-cinder-816187-2-iscsi is: [{'id': '2b283ba5-8550-4152-a1be-c8c7a628d94b', 'name': 'tempest-TestShelveInstance-632815821-router', 'tenant_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '2793bc35-fa22-41fb-bd57-390a71fb9687', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:21:51Z', 'updated_at': '2021-11-08T16:21:54Z', 'revision_number': 4, 'project_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'gw_port': {'id': '2793bc35-fa22-41fb-bd57-390a71fb9687', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:cf:21', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2b283ba5-8550-4152-a1be-c8c7a628d94b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 578, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:52Z', 'updated_at': '2021-11-08T16:21:55Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': 'f2f60e0f-a89e-47cf-9555-ff4b78af6adb', 'name': '', 'network_id': '5a75ccbd-4f9f-4f1a-b9e5-4921f028e916', 'tenant_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'mac_address': 'fa:16:3e:60:97:d0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2b283ba5-8550-4152-a1be-c8c7a628d94b', 'device_owner': 'network:router_interface', 'standard_attr_id': 579, 'fixed_ips': [{'subnet_id': '4b234dcd-085a-48b7-8b98-50c1a76e059b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:53Z', 'updated_at': '2021-11-08T16:21:54Z', 'revision_number': 2, 'project_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'subnets': [{'id': '4b234dcd-085a-48b7-8b98-50c1a76e059b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:21:56.209324 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61b1c9a9-50c4-41bd-a287-05783107332e req-da85ce0f-69a4-4ccc-8c94-7caa4c299041 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:56.211351 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-61b1c9a9-50c4-41bd-a287-05783107332e req-da85ce0f-69a4-4ccc-8c94-7caa4c299041 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0737250 Nov 08 16:21:56.242965 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 41956) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:56.247265 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-b7e91df6-dc9b-4d38-b4bd-6de27eaf4fe2 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1970754233', 'description': 'tempest-secgroup-smoke-1970754233 description', 'project_id': '71b067e1fbac491a8e16a4ba91049db9'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:21:56.264584 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-ab1be52e-3d0e-44de-87a2-511deb58cbab None None] Provisioning complete for port f2f60e0f-a89e-47cf-9555-ff4b78af6adb triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:21:56.264981 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ab1be52e-3d0e-44de-87a2-511deb58cbab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:56.301360 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 3a14a839-f3ee-4231-a9b5-00067b56ef01 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:21:56.301746 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:56.304700 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b7e91df6-dc9b-4d38-b4bd-6de27eaf4fe2 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:56.335343 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-ab1be52e-3d0e-44de-87a2-511deb58cbab None None] Port f2f60e0f-a89e-47cf-9555-ff4b78af6adb cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:21:56.452817 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b7e91df6-dc9b-4d38-b4bd-6de27eaf4fe2 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:56.458170 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b7e91df6-dc9b-4d38-b4bd-6de27eaf4fe2 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:56.505743 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b7e91df6-dc9b-4d38-b4bd-6de27eaf4fe2 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:56.510004 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-b7e91df6-dc9b-4d38-b4bd-6de27eaf4fe2 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.2633965 Nov 08 16:21:56.510503 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 41962) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:56.516252 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-bc07b455-c159-4269-b45d-f2e93f85e027 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Request body: {'security_group_rule': {'security_group_id': 'da359123-5a1e-4b60-8d5a-f50c1ee0c53b', 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:21:56.521030 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7e91df6-dc9b-4d38-b4bd-6de27eaf4fe2 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Pushing event updated for resources: {'SecurityGroup': ['ID=da359123-5a1e-4b60-8d5a-f50c1ee0c53b,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:56.555608 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bc07b455-c159-4269-b45d-f2e93f85e027 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:56.600160 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-61b1c9a9-50c4-41bd-a287-05783107332e req-41a701fc-5543-49e2-bc5e-fd8edae129a6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3818977 Nov 08 16:21:56.648938 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bc07b455-c159-4269-b45d-f2e93f85e027 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:56.652765 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bc07b455-c159-4269-b45d-f2e93f85e027 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:56.671248 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc07b455-c159-4269-b45d-f2e93f85e027 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=42b95ed1-4312-4f24-b1a2-7f2d69177b11,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:56.682433 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bc07b455-c159-4269-b45d-f2e93f85e027 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:56.686497 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-bc07b455-c159-4269-b45d-f2e93f85e027 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1722045 Nov 08 16:21:56.686634 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 41964) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:56.691751 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-c85b3dd8-b251-4a28-80bb-fa46901fb12d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Request body: {'security_group_rule': {'security_group_id': 'da359123-5a1e-4b60-8d5a-f50c1ee0c53b', 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:21:56.721922 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c85b3dd8-b251-4a28-80bb-fa46901fb12d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:56.791616 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c85b3dd8-b251-4a28-80bb-fa46901fb12d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:56.798771 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c85b3dd8-b251-4a28-80bb-fa46901fb12d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:56.817633 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c85b3dd8-b251-4a28-80bb-fa46901fb12d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e00eefd8-d1ed-4811-b153-41def3769e01,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:56.825319 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-c85b3dd8-b251-4a28-80bb-fa46901fb12d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:56.826561 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-c85b3dd8-b251-4a28-80bb-fa46901fb12d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1390760 Nov 08 16:21:56.830248 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 41966) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:56.834771 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-71251e31-5690-4fc5-99c6-7e91e658ba74 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Request body: {'security_group_rule': {'security_group_id': 'da359123-5a1e-4b60-8d5a-f50c1ee0c53b', 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:21:56.863833 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-71251e31-5690-4fc5-99c6-7e91e658ba74 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:56.930454 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-71251e31-5690-4fc5-99c6-7e91e658ba74 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:56.934159 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-71251e31-5690-4fc5-99c6-7e91e658ba74 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:56.952060 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71251e31-5690-4fc5-99c6-7e91e658ba74 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c4b68ab0-f834-4db1-bf5d-31f86290da1e,revision_number=0']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:56.959286 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-71251e31-5690-4fc5-99c6-7e91e658ba74 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:56.960457 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-71251e31-5690-4fc5-99c6-7e91e658ba74 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1291935 Nov 08 16:21:56.963314 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 41968) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:56.967551 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [None req-4c19b163-7ebb-4abf-b7f4-44f55080db84 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Request body: {'security_group_rule': {'security_group_id': 'da359123-5a1e-4b60-8d5a-f50c1ee0c53b', 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:21:56.992950 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-4c19b163-7ebb-4abf-b7f4-44f55080db84 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:57.046868 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-4c19b163-7ebb-4abf-b7f4-44f55080db84 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:57.051003 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-4c19b163-7ebb-4abf-b7f4-44f55080db84 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:57.068235 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c19b163-7ebb-4abf-b7f4-44f55080db84 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a013506e-f39d-487a-a16f-4c5fd990116e,revision_number=0']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:57.082756 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-4c19b163-7ebb-4abf-b7f4-44f55080db84 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:57.082756 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-4c19b163-7ebb-4abf-b7f4-44f55080db84 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1166058 Nov 08 16:21:57.083971 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 41972) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:57.091043 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-0b008680-459d-4d91-8f93-201543e352ee tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Request body: {'security_group_rule': {'security_group_id': 'da359123-5a1e-4b60-8d5a-f50c1ee0c53b', 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:21:57.115714 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.db.securitygroups_db [None req-0b008680-459d-4d91-8f93-201543e352ee tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Project 71b067e1fbac491a8e16a4ba91049db9 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 08 16:21:57.121398 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0b008680-459d-4d91-8f93-201543e352ee tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:57.181324 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0b008680-459d-4d91-8f93-201543e352ee tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:57.185500 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0b008680-459d-4d91-8f93-201543e352ee tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:57.205107 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b008680-459d-4d91-8f93-201543e352ee tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b286eda6-1cca-49fd-bbaa-474bae0b235a,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:57.210702 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0b008680-459d-4d91-8f93-201543e352ee tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:57.211839 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-0b008680-459d-4d91-8f93-201543e352ee tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1264858 Nov 08 16:21:57.214612 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 41976) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:21:57.218858 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-af906f5e-a887-44fa-8c59-07ba621e1fc6 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Request body: {'security_group_rule': {'security_group_id': 'da359123-5a1e-4b60-8d5a-f50c1ee0c53b', 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:21:57.241780 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.db.securitygroups_db [None req-af906f5e-a887-44fa-8c59-07ba621e1fc6 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Project 71b067e1fbac491a8e16a4ba91049db9 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 08 16:21:57.246696 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-af906f5e-a887-44fa-8c59-07ba621e1fc6 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:57.306703 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-af906f5e-a887-44fa-8c59-07ba621e1fc6 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:57.310655 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-af906f5e-a887-44fa-8c59-07ba621e1fc6 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081618'] for security_group_rule, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:57.327160 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af906f5e-a887-44fa-8c59-07ba621e1fc6 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1d55d045-8cbf-4d5b-8475-5680a8265720,revision_number=0']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:57.328180 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-710f343f-6033-4078-b5a4-0ba0d6a52fee req-f8b38be0-f4ac-4086-8220-7c17f9c42569 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:57.329688 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-710f343f-6033-4078-b5a4-0ba0d6a52fee req-f8b38be0-f4ac-4086-8220-7c17f9c42569 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7&tenant_id=10a4252a63bf480d93d2e9da15bb8efd HTTP/1.1" status: 200 len: 1097 time: 0.1329849 Nov 08 16:21:57.336730 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-af906f5e-a887-44fa-8c59-07ba621e1fc6 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:57.337922 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-af906f5e-a887-44fa-8c59-07ba621e1fc6 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1223869 Nov 08 16:21:57.414083 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-710f343f-6033-4078-b5a4-0ba0d6a52fee req-0af13a65-be35-417c-872f-5b75d0ecf85b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:57.415574 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-710f343f-6033-4078-b5a4-0ba0d6a52fee req-0af13a65-be35-417c-872f-5b75d0ecf85b service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=10a4252a63bf480d93d2e9da15bb8efd&device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 1097 time: 0.0597382 Nov 08 16:21:57.521850 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-710f343f-6033-4078-b5a4-0ba0d6a52fee req-beedbc31-b113-4673-9233-0916ad3c7ec6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:57.523650 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-710f343f-6033-4078-b5a4-0ba0d6a52fee req-beedbc31-b113-4673-9233-0916ad3c7ec6 service neutron] 10.222.0.25 "GET /v2.0/networks?id=e0e08679-82fe-47eb-90b6-49a1713fdaca HTTP/1.1" status: 200 len: 918 time: 0.1000471 Nov 08 16:21:57.603518 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-710f343f-6033-4078-b5a4-0ba0d6a52fee req-6c19b1d4-dcb9-4126-8740-afd8e94ac886 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b3094cea-72ef-41cf-ac88-a6d678f0fb09 HTTP/1.1" status: 200 len: 999 time: 0.0703807 Nov 08 16:21:57.659101 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-710f343f-6033-4078-b5a4-0ba0d6a52fee req-6a32c8fb-f877-4d6f-ab8c-6dc78c173956 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:57.660636 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-710f343f-6033-4078-b5a4-0ba0d6a52fee req-6a32c8fb-f877-4d6f-ab8c-6dc78c173956 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=fc52ff8b-1692-487b-a0de-f6290e65d880 HTTP/1.1" status: 200 len: 856 time: 0.0484817 Nov 08 16:21:57.736330 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 2793bc35-fa22-41fb-bd57-390a71fb9687 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:21:57.746008 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-710f343f-6033-4078-b5a4-0ba0d6a52fee req-ef99ac22-648d-402c-ac4e-c298441ae47d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:57.748459 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-710f343f-6033-4078-b5a4-0ba0d6a52fee req-ef99ac22-648d-402c-ac4e-c298441ae47d service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=e0e08679-82fe-47eb-90b6-49a1713fdaca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0799284 Nov 08 16:21:57.804295 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 2793bc35-fa22-41fb-bd57-390a71fb9687 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:21:57.805043 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:57.819000 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9ac50e0-a195-43af-bd05-0d41fe1eac33 req-b8a75968-0ed6-40d0-818b-6cab6e4f0d62 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:57.826656 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a9ac50e0-a195-43af-bd05-0d41fe1eac33 req-b8a75968-0ed6-40d0-818b-6cab6e4f0d62 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.1231365 Nov 08 16:21:57.914994 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:57.933052 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a9ac50e0-a195-43af-bd05-0d41fe1eac33 req-3ea8fea9-5bcb-4120-84a6-15ca4f6c82d1 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1032755 Nov 08 16:21:57.937341 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-710f343f-6033-4078-b5a4-0ba0d6a52fee req-68a53b18-f4fd-42dc-a6cc-9ee9715a6e8f service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1812539 Nov 08 16:21:57.957624 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] For port 2793bc35-fa22-41fb-bd57-390a71fb9687, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=2793bc35-fa22-41fb-bd57-390a71fb9687,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:21:57.964424 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:58.037465 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Pushing event updated for resources: {'Port': ['ID=2793bc35-fa22-41fb-bd57-390a71fb9687,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:58.070929 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-710f343f-6033-4078-b5a4-0ba0d6a52fee req-a8eccad8-4dfc-474c-ae1f-8d91358d1024 service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1253502 Nov 08 16:21:58.960404 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device b3094cea-72ef-41cf-ac88-a6d678f0fb09 no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:21:59.057267 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] Sync routers for ids ['2b283ba5-8550-4152-a1be-c8c7a628d94b'] in dv-cinder-816187-2-iscsi {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:21:59.069376 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] Routers {'2b283ba5-8550-4152-a1be-c8c7a628d94b'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:21:59.070152 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:21:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['2b283ba5-8550-4152-a1be-c8c7a628d94b'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:59.115271 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a35dce3f-093f-4944-9713-d5061a602ce9 req-ed8d28b0-02c4-46d5-b354-b02939467a8c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:21:59.117901 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a35dce3f-093f-4944-9713-d5061a602ce9 req-ed8d28b0-02c4-46d5-b354-b02939467a8c tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0714388 Nov 08 16:21:59.190049 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a35dce3f-093f-4944-9713-d5061a602ce9 req-e120ca45-6c0f-4c50-9249-ed6a7fee1eb5 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0647111 Nov 08 16:21:59.198224 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] Set router 2b283ba5-8550-4152-a1be-c8c7a628d94b gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:21:59.493147 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b283ba5-8550-4152-a1be-c8c7a628d94b', 'name': 'tempest-TestShelveInstance-632815821-router', 'tenant_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '2793bc35-fa22-41fb-bd57-390a71fb9687', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:21:51Z', 'updated_at': '2021-11-08T16:21:54Z', 'revision_number': 4, 'project_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'gw_port': {'id': '2793bc35-fa22-41fb-bd57-390a71fb9687', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:cf:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b283ba5-8550-4152-a1be-c8c7a628d94b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 578, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:52Z', 'updated_at': '2021-11-08T16:21:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': 'f2f60e0f-a89e-47cf-9555-ff4b78af6adb', 'name': '', 'network_id': '5a75ccbd-4f9f-4f1a-b9e5-4921f028e916', 'tenant_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'mac_address': 'fa:16:3e:60:97:d0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2b283ba5-8550-4152-a1be-c8c7a628d94b', 'device_owner': 'network:router_interface', 'standard_attr_id': 579, 'fixed_ips': [{'subnet_id': '4b234dcd-085a-48b7-8b98-50c1a76e059b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:53Z', 'updated_at': '2021-11-08T16:21:54Z', 'revision_number': 2, 'project_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'subnets': [{'id': '4b234dcd-085a-48b7-8b98-50c1a76e059b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:21:59.519570 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] Checking router: 2b283ba5-8550-4152-a1be-c8c7a628d94b for host: dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:21:59.519916 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] Updating router 2b283ba5-8550-4152-a1be-c8c7a628d94b port f2f60e0f-a89e-47cf-9555-ff4b78af6adb binding host dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 16:21:59.546021 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:59.675653 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 2793bc35-fa22-41fb-bd57-390a71fb9687 up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:21:59.726128 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port 2793bc35-fa22-41fb-bd57-390a71fb9687 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:21:59.726500 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:59.849812 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] Publish callbacks [] for port, precommit_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:59.856353 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:59.909647 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd557a16-b75e-4be8-a000-d721692a9535 None None] Pushing event updated for resources: {'Port': ['ID=f2f60e0f-a89e-47cf-9555-ff4b78af6adb,revision_number=3']} {{(pid=101247) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:21:59.971429 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] Attempting to bind port f2f60e0f-a89e-47cf-9555-ff4b78af6adb on host dv-cinder-816187-2-iscsi for vnic_type normal with profile {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:21:59.971903 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] Attempting to bind port f2f60e0f-a89e-47cf-9555-ff4b78af6adb by drivers openvswitch,hyperv on host dv-cinder-816187-2-iscsi at level 0 using segments [{'id': '10cf7f40-17b2-437d-b05e-09a41ffbf808', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 168, 'network_id': '5a75ccbd-4f9f-4f1a-b9e5-4921f028e916'}] {{(pid=101247) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:21:59.972326 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] Attempting to bind port f2f60e0f-a89e-47cf-9555-ff4b78af6adb on network 5a75ccbd-4f9f-4f1a-b9e5-4921f028e916 {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:21:59.977662 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] Checking agent: {'id': 'dd16a477-e211-4563-81ed-263b25ce1697', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816187-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 3, 14), 'started_at': datetime.datetime(2021, 11, 8, 16, 3, 44), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 21, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816187-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:21:59.978146 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] Checking segment: {'id': '10cf7f40-17b2-437d-b05e-09a41ffbf808', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 168, 'network_id': '5a75ccbd-4f9f-4f1a-b9e5-4921f028e916'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101247) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:21:59.978607 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:21:59.979060 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] Bound using segment: {'id': '10cf7f40-17b2-437d-b05e-09a41ffbf808', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 168, 'network_id': '5a75ccbd-4f9f-4f1a-b9e5-4921f028e916'} {{(pid=101247) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:21:59.979598 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.managers [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] Bound port: f2f60e0f-a89e-47cf-9555-ff4b78af6adb, host: dv-cinder-816187-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10cf7f40-17b2-437d-b05e-09a41ffbf808', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 168, 'network_id': '5a75ccbd-4f9f-4f1a-b9e5-4921f028e916'}}] {{(pid=101247) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:21:59.980060 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:00.046190 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.db [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] For port f2f60e0f-a89e-47cf-9555-ff4b78af6adb, host dv-cinder-816187-2-iscsi, cleared binding levels {{(pid=101247) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:22:00.049516 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.plugins.ml2.db [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] For port f2f60e0f-a89e-47cf-9555-ff4b78af6adb, host dv-cinder-816187-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=f2f60e0f-a89e-47cf-9555-ff4b78af6adb,segment=NetworkSegment(10cf7f40-17b2-437d-b05e-09a41ffbf808),segment_id=10cf7f40-17b2-437d-b05e-09a41ffbf808)] {{(pid=101247) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:22:00.054098 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron_lib.callbacks.manager [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101247) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:00.105792 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] Routers {'2b283ba5-8550-4152-a1be-c8c7a628d94b'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:22:00.107215 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:21:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['2b283ba5-8550-4152-a1be-c8c7a628d94b'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:22:00.188711 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-38582880-881e-4e73-94f7-60b6d70abf92 None None] Provisioning complete for port f2f60e0f-a89e-47cf-9555-ff4b78af6adb triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:22:00.190337 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-38582880-881e-4e73-94f7-60b6d70abf92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:00.190891 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd557a16-b75e-4be8-a000-d721692a9535 None None] Pushing event updated for resources: {'Port': ['ID=f2f60e0f-a89e-47cf-9555-ff4b78af6adb,revision_number=4']} {{(pid=101247) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:22:00.274032 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] Set router 2b283ba5-8550-4152-a1be-c8c7a628d94b gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:22:00.340378 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-38582880-881e-4e73-94f7-60b6d70abf92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:00.388658 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a25c33b5-72b6-4c31-976f-ba73b20ef3fe req-ed7d8a0d-9ab8-4834-af4a-fe3f9e3dd452 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:00.390227 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a25c33b5-72b6-4c31-976f-ba73b20ef3fe req-ed7d8a0d-9ab8-4834-af4a-fe3f9e3dd452 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0713112 Nov 08 16:22:00.395665 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-38582880-881e-4e73-94f7-60b6d70abf92 None None] For port f2f60e0f-a89e-47cf-9555-ff4b78af6adb, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=f2f60e0f-a89e-47cf-9555-ff4b78af6adb,segment=NetworkSegment(10cf7f40-17b2-437d-b05e-09a41ffbf808),segment_id=10cf7f40-17b2-437d-b05e-09a41ffbf808)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:22:00.403011 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-38582880-881e-4e73-94f7-60b6d70abf92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:00.458428 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a25c33b5-72b6-4c31-976f-ba73b20ef3fe req-41725394-3fdc-4261-9fdb-2e6aa042812e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0602627 Nov 08 16:22:00.468478 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38582880-881e-4e73-94f7-60b6d70abf92 None None] Pushing event updated for resources: {'Port': ['ID=f2f60e0f-a89e-47cf-9555-ff4b78af6adb,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:22:00.529344 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-7a60b38a-70ae-48de-a9d6-58ec3b036930 None None] Provisioning complete for port f2f60e0f-a89e-47cf-9555-ff4b78af6adb triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:22:00.529637 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-7a60b38a-70ae-48de-a9d6-58ec3b036930 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:00.583938 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b283ba5-8550-4152-a1be-c8c7a628d94b', 'name': 'tempest-TestShelveInstance-632815821-router', 'tenant_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '2793bc35-fa22-41fb-bd57-390a71fb9687', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:21:51Z', 'updated_at': '2021-11-08T16:21:54Z', 'revision_number': 4, 'project_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'gw_port': {'id': '2793bc35-fa22-41fb-bd57-390a71fb9687', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:cf:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b283ba5-8550-4152-a1be-c8c7a628d94b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 578, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:52Z', 'updated_at': '2021-11-08T16:21:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': 'f2f60e0f-a89e-47cf-9555-ff4b78af6adb', 'name': '', 'network_id': '5a75ccbd-4f9f-4f1a-b9e5-4921f028e916', 'tenant_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'mac_address': 'fa:16:3e:60:97:d0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2b283ba5-8550-4152-a1be-c8c7a628d94b', 'device_owner': 'network:router_interface', 'standard_attr_id': 579, 'fixed_ips': [{'subnet_id': '4b234dcd-085a-48b7-8b98-50c1a76e059b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:53Z', 'updated_at': '2021-11-08T16:22:00Z', 'revision_number': 4, 'project_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'subnets': [{'id': '4b234dcd-085a-48b7-8b98-50c1a76e059b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:22:00.609424 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27579921-6b83-4c79-a323-141dd0b21354 None None] The sync data for ids ['2b283ba5-8550-4152-a1be-c8c7a628d94b'] in dv-cinder-816187-2-iscsi is: [{'id': '2b283ba5-8550-4152-a1be-c8c7a628d94b', 'name': 'tempest-TestShelveInstance-632815821-router', 'tenant_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '2793bc35-fa22-41fb-bd57-390a71fb9687', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:21:51Z', 'updated_at': '2021-11-08T16:21:54Z', 'revision_number': 4, 'project_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'gw_port': {'id': '2793bc35-fa22-41fb-bd57-390a71fb9687', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:cf:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b283ba5-8550-4152-a1be-c8c7a628d94b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 578, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:52Z', 'updated_at': '2021-11-08T16:21:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': 'f2f60e0f-a89e-47cf-9555-ff4b78af6adb', 'name': '', 'network_id': '5a75ccbd-4f9f-4f1a-b9e5-4921f028e916', 'tenant_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'mac_address': 'fa:16:3e:60:97:d0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2b283ba5-8550-4152-a1be-c8c7a628d94b', 'device_owner': 'network:router_interface', 'standard_attr_id': 579, 'fixed_ips': [{'subnet_id': '4b234dcd-085a-48b7-8b98-50c1a76e059b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:53Z', 'updated_at': '2021-11-08T16:22:00Z', 'revision_number': 4, 'project_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'subnets': [{'id': '4b234dcd-085a-48b7-8b98-50c1a76e059b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:22:01.581431 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b1fbe69-1271-4895-b007-37a55c8295d4 req-09f1a4e1-0599-43e9-b2cf-88c84572e862 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:01.583758 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7b1fbe69-1271-4895-b007-37a55c8295d4 req-09f1a4e1-0599-43e9-b2cf-88c84572e862 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0562820 Nov 08 16:22:01.634041 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-7b1fbe69-1271-4895-b007-37a55c8295d4 req-69b2bbd2-7b33-4edf-9f7a-8dcb64a1efeb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442266 Nov 08 16:22:01.709482 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device f2f60e0f-a89e-47cf-9555-ff4b78af6adb up at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:22:01.883458 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Provisioning complete for port f2f60e0f-a89e-47cf-9555-ff4b78af6adb triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:22:01.883831 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:02.772656 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c628df3d-d643-44c2-990c-f9eb0119ac91 req-c30d38e0-22e2-4572-a357-e942381080c6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:02.774323 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c628df3d-d643-44c2-990c-f9eb0119ac91 req-c30d38e0-22e2-4572-a357-e942381080c6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0496545 Nov 08 16:22:02.827038 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c628df3d-d643-44c2-990c-f9eb0119ac91 req-efbc0eff-0fd9-4de3-b7f4-bdd8c5d64235 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457799 Nov 08 16:22:03.953781 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8ea7e3b-a8c8-4b1a-bd0e-d9a07f9c2b54 req-0b0d2226-418f-49ad-b55d-e15f9477f717 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:03.956142 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f8ea7e3b-a8c8-4b1a-bd0e-d9a07f9c2b54 req-0b0d2226-418f-49ad-b55d-e15f9477f717 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0510473 Nov 08 16:22:04.015019 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f8ea7e3b-a8c8-4b1a-bd0e-d9a07f9c2b54 req-e0fda622-6fb4-484a-a26e-da6e9b727c51 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0529115 Nov 08 16:22:05.163266 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d1773e4-406b-4bd2-b025-2c3e83a244ae req-366d822b-c059-4cd8-80be-0ea7043f6b3d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:05.164951 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4d1773e4-406b-4bd2-b025-2c3e83a244ae req-366d822b-c059-4cd8-80be-0ea7043f6b3d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0505784 Nov 08 16:22:05.210896 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4d1773e4-406b-4bd2-b025-2c3e83a244ae req-dda083f4-329a-4fd7-b7fb-54ee5373a16f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0397263 Nov 08 16:22:06.347660 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39b51aa2-5e66-46bf-9ab3-0e678f603dff req-da57649c-a37d-4b9e-9455-5102820fff51 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:06.349244 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-39b51aa2-5e66-46bf-9ab3-0e678f603dff req-da57649c-a37d-4b9e-9455-5102820fff51 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0643573 Nov 08 16:22:06.399244 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-39b51aa2-5e66-46bf-9ab3-0e678f603dff req-2c2fe097-569d-431a-8d41-c06698d99f80 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439656 Nov 08 16:22:07.534097 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90ad01d9-028c-4184-8953-049bb9dc1703 req-83de0e29-3594-4451-a68a-a86893d52ab6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:07.535574 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-90ad01d9-028c-4184-8953-049bb9dc1703 req-83de0e29-3594-4451-a68a-a86893d52ab6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0498059 Nov 08 16:22:07.581381 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-90ad01d9-028c-4184-8953-049bb9dc1703 req-16c72735-b448-4c12-8a16-e7b836b81793 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400646 Nov 08 16:22:08.130602 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-1f28b5bb-902e-4a15-9806-e68a077c4a38 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:08.703850 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c273a15b-6cac-4337-aec6-5951363db9fc req-4c68d27f-bbfe-4cd3-990b-7ee3d492de86 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:08.705237 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c273a15b-6cac-4337-aec6-5951363db9fc req-4c68d27f-bbfe-4cd3-990b-7ee3d492de86 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0509927 Nov 08 16:22:08.750047 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c273a15b-6cac-4337-aec6-5951363db9fc req-f1a0c7a9-2aed-4f80-a9c4-c5e1222cdfb3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0387006 Nov 08 16:22:09.878208 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99906968-4b4d-4b6e-9a6a-c610289e957d req-1455e467-db58-4166-9479-545297edb6d0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:09.879752 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-99906968-4b4d-4b6e-9a6a-c610289e957d req-1455e467-db58-4166-9479-545297edb6d0 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0515578 Nov 08 16:22:09.929570 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-99906968-4b4d-4b6e-9a6a-c610289e957d req-18dc6f7a-91f0-4c8a-a4b2-7772dda67da6 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435855 Nov 08 16:22:10.600763 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-a67d9817-e6c7-4a2b-a504-5cf75922d724 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:11.049050 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef7ab381-558e-4e53-a812-2e2658878372 req-bde6f723-77c1-4a04-ba2d-a517dbe968e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:11.050536 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ef7ab381-558e-4e53-a812-2e2658878372 req-bde6f723-77c1-4a04-ba2d-a517dbe968e9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0472262 Nov 08 16:22:11.099665 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ef7ab381-558e-4e53-a812-2e2658878372 req-8aa6e371-6a71-4818-ab62-d24c7cbf58d4 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433683 Nov 08 16:22:11.561015 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:12.222626 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f80fd32a-915e-4a28-9490-5525dc9a40ec req-52c5b09c-6ab9-4484-96f0-d49f844559f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:12.224117 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f80fd32a-915e-4a28-9490-5525dc9a40ec req-52c5b09c-6ab9-4484-96f0-d49f844559f9 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0472753 Nov 08 16:22:12.270056 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f80fd32a-915e-4a28-9490-5525dc9a40ec req-962c222c-0fb5-49c3-b59c-901413a10e58 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402224 Nov 08 16:22:13.290100 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:13.387105 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1af8c28c-ceb5-4220-abae-17c1de6f41f9 req-9ba4ed4f-5bff-44f9-a313-087f13912c11 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:13.388506 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1af8c28c-ceb5-4220-abae-17c1de6f41f9 req-9ba4ed4f-5bff-44f9-a313-087f13912c11 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0483482 Nov 08 16:22:13.433778 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1af8c28c-ceb5-4220-abae-17c1de6f41f9 req-c8c05ba3-3c98-42f4-8540-d8e00dfc914d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0387859 Nov 08 16:22:13.968151 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:14.554374 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b24abdf7-c66b-4f16-85c0-7c121dce4a16 req-372fc9ef-16ea-402b-afef-ad697e1ceb62 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:14.556130 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b24abdf7-c66b-4f16-85c0-7c121dce4a16 req-372fc9ef-16ea-402b-afef-ad697e1ceb62 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0512674 Nov 08 16:22:14.601696 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b24abdf7-c66b-4f16-85c0-7c121dce4a16 req-23750e34-1853-4a5d-8715-6822aa8a8216 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0397005 Nov 08 16:22:15.717693 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2127c1f-7f3f-43e4-b028-05ce45da1fcd req-832ce608-365e-4bc4-b6fc-ccc553434d43 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:15.719159 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c2127c1f-7f3f-43e4-b028-05ce45da1fcd req-832ce608-365e-4bc4-b6fc-ccc553434d43 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0476272 Nov 08 16:22:15.764825 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c2127c1f-7f3f-43e4-b028-05ce45da1fcd req-d9fe4377-1ad1-4003-813b-32853dddf874 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398829 Nov 08 16:22:16.882911 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fe6b782-81a2-4aee-96f0-868434565b64 req-fc450457-5201-49a6-bd45-20707543ac66 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:16.884640 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4fe6b782-81a2-4aee-96f0-868434565b64 req-fc450457-5201-49a6-bd45-20707543ac66 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0492408 Nov 08 16:22:16.933895 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4fe6b782-81a2-4aee-96f0-868434565b64 req-2effaecb-dbd6-45e3-9251-6dd2f35bff58 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434749 Nov 08 16:22:18.002119 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:18.052601 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b30dac6a-0302-4460-9535-4bdf6cb8cb62 req-845f5a62-fb32-4016-88c3-48447e4e0f01 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:18.054070 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b30dac6a-0302-4460-9535-4bdf6cb8cb62 req-845f5a62-fb32-4016-88c3-48447e4e0f01 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0467958 Nov 08 16:22:18.100402 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-b30dac6a-0302-4460-9535-4bdf6cb8cb62 req-a89f60fb-15a9-4eb5-a7e0-2e3f5f00b76b tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405147 Nov 08 16:22:19.216973 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32600903-e1ab-4fa9-a297-3e30a10ecc98 req-7740a1cd-1fd2-4719-953e-6032770f7f34 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:19.218359 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-32600903-e1ab-4fa9-a297-3e30a10ecc98 req-7740a1cd-1fd2-4719-953e-6032770f7f34 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0478225 Nov 08 16:22:19.264733 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-32600903-e1ab-4fa9-a297-3e30a10ecc98 req-0883826e-663b-4404-b011-7fee8da612cf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405259 Nov 08 16:22:20.385470 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1489a5ba-0dfd-4745-899e-a27661d5218d req-23484c25-2921-425f-97c1-ba80cfb5f52a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:20.387103 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1489a5ba-0dfd-4745-899e-a27661d5218d req-23484c25-2921-425f-97c1-ba80cfb5f52a tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0520904 Nov 08 16:22:20.435060 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1489a5ba-0dfd-4745-899e-a27661d5218d req-6cd49dfe-a070-44af-ac64-5624ea009575 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413418 Nov 08 16:22:21.333427 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-388025d7-63c7-4915-9a59-3e8232997c4f req-53967f64-a920-445f-9784-fc2547f37707 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:21.334902 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-388025d7-63c7-4915-9a59-3e8232997c4f req-53967f64-a920-445f-9784-fc2547f37707 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=10a4252a63bf480d93d2e9da15bb8efd&device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 1097 time: 0.0383592 Nov 08 16:22:21.437432 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-388025d7-63c7-4915-9a59-3e8232997c4f req-37646798-c3d1-4f8d-8270-aaf3bfccbd58 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:21.438958 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-388025d7-63c7-4915-9a59-3e8232997c4f req-37646798-c3d1-4f8d-8270-aaf3bfccbd58 service neutron] 10.222.0.25 "GET /v2.0/networks?id=e0e08679-82fe-47eb-90b6-49a1713fdaca HTTP/1.1" status: 200 len: 918 time: 0.0846450 Nov 08 16:22:21.506081 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-388025d7-63c7-4915-9a59-3e8232997c4f req-002f5a1f-f7f9-46f2-a207-2d36ed32321d service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b3094cea-72ef-41cf-ac88-a6d678f0fb09 HTTP/1.1" status: 200 len: 999 time: 0.0592172 Nov 08 16:22:21.580179 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-388025d7-63c7-4915-9a59-3e8232997c4f req-57124fda-9c63-4e8d-82ef-60ecdf28316f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:21.581586 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-388025d7-63c7-4915-9a59-3e8232997c4f req-57124fda-9c63-4e8d-82ef-60ecdf28316f service neutron] 10.222.0.25 "GET /v2.0/subnets?id=fc52ff8b-1692-487b-a0de-f6290e65d880 HTTP/1.1" status: 200 len: 856 time: 0.0666881 Nov 08 16:22:21.589882 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdacb398-b7b1-4226-a9c0-fc54601f135e req-aa804002-1c49-47c8-af9e-7af812c3fb43 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:21.591218 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bdacb398-b7b1-4226-a9c0-fc54601f135e req-aa804002-1c49-47c8-af9e-7af812c3fb43 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0843120 Nov 08 16:22:21.661296 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bdacb398-b7b1-4226-a9c0-fc54601f135e req-ca9e24c7-a855-443d-8ec9-d362a29829ae tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0614460 Nov 08 16:22:21.663928 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-388025d7-63c7-4915-9a59-3e8232997c4f req-45537f2c-7548-442f-b4c1-60357deca2a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:21.665312 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-388025d7-63c7-4915-9a59-3e8232997c4f req-45537f2c-7548-442f-b4c1-60357deca2a8 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=e0e08679-82fe-47eb-90b6-49a1713fdaca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0732877 Nov 08 16:22:21.758517 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-388025d7-63c7-4915-9a59-3e8232997c4f req-ab9bbde6-55b4-4364-b660-23ef55c57827 service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0834203 Nov 08 16:22:21.846575 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-388025d7-63c7-4915-9a59-3e8232997c4f req-7179885b-cde1-4352-be37-dc92e221f93c service neutron] 10.222.0.25 "GET /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0794599 Nov 08 16:22:22.781757 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-503ad185-2238-4c14-b1ac-d2eb6a019e47 req-5abf51f4-8f89-41a7-abd5-746f41209d22 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:22.783762 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-503ad185-2238-4c14-b1ac-d2eb6a019e47 req-5abf51f4-8f89-41a7-abd5-746f41209d22 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0489447 Nov 08 16:22:22.832290 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-503ad185-2238-4c14-b1ac-d2eb6a019e47 req-c0058d19-a9b9-4edc-a82c-7a9084afebc8 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426610 Nov 08 16:22:23.949442 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-045d9dfa-8c96-440f-9881-ee6d796d6166 req-bfc63f5b-fa8a-4274-a1f6-507e120b9c6f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:23.950831 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-045d9dfa-8c96-440f-9881-ee6d796d6166 req-bfc63f5b-fa8a-4274-a1f6-507e120b9c6f tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0481067 Nov 08 16:22:23.997065 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-045d9dfa-8c96-440f-9881-ee6d796d6166 req-d70f5f0a-90a6-4ba3-96b7-c562660ad4bb tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399399 Nov 08 16:22:24.321583 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-2f9c74b7-523f-44e3-af73-765fa87b2bb5 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1970754233&fields=id&tenant_id=71b067e1fbac491a8e16a4ba91049db9 HTTP/1.1" status: 200 len: 267 time: 0.0426631 Nov 08 16:22:24.425975 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-fa027018-686f-45b4-9d5c-88ab8b9fa1ad tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:24.427412 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-fa027018-686f-45b4-9d5c-88ab8b9fa1ad tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/networks?id=f9b0f22e-a782-44ad-bfe0-8de1f795305e HTTP/1.1" status: 200 len: 809 time: 0.0992858 Nov 08 16:22:24.441514 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-b3c3d0df-cee2-4f39-a62d-d118d6fda1c1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/quotas/71b067e1fbac491a8e16a4ba91049db9 HTTP/1.1" status: 200 len: 375 time: 0.0085263 Nov 08 16:22:24.490569 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-cedcc40e-d7f3-4f11-8ce5-4f5c2de3cee9 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?tenant_id=71b067e1fbac491a8e16a4ba91049db9&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0440059 Nov 08 16:22:24.505909 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-3968278a-65fe-4bf2-a4d6-ead46cc20aed service neutron] http://10.222.0.37:9696/v2.0/extensions returned with HTTP 200 {{(pid=101244) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 16:22:24.506841 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-3968278a-65fe-4bf2-a4d6-ead46cc20aed service neutron] 10.222.0.37 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0048563 Nov 08 16:22:24.591104 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-a94396e6-27d7-4258-b687-69e52875409f service neutron] 10.222.0.37 "GET /v2.0/networks/f9b0f22e-a782-44ad-bfe0-8de1f795305e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0788577 Nov 08 16:22:24.598478 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:22:24.680348 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-b1d5dded-5d67-4031-ac42-70f4f85d5e5b service neutron] 10.222.0.37 "GET /v2.0/networks/f9b0f22e-a782-44ad-bfe0-8de1f795305e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0827649 Nov 08 16:22:24.948532 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9aba1bbf-a15f-40d9-b1b4-13582ac73e25 req-e2de6cde-5971-410e-b3c3-fd84aaf8f760 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 210 time: 0.0261648 Nov 08 16:22:25.044922 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device b3094cea-72ef-41cf-ac88-a6d678f0fb09 details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:22:25.137333 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9526bb51-7aae-4fb6-8660-ef1575a75a29 req-8589a7f9-613d-49b8-8be4-ca5d39c7b014 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:25.138874 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9526bb51-7aae-4fb6-8660-ef1575a75a29 req-8589a7f9-613d-49b8-8be4-ca5d39c7b014 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 944 time: 0.0680413 Nov 08 16:22:25.145507 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port b3094cea-72ef-41cf-ac88-a6d678f0fb09, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=b3094cea-72ef-41cf-ac88-a6d678f0fb09,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:22:25.161346 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': 'b3094cea-72ef-41cf-ac88-a6d678f0fb09', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'port_id': 'b3094cea-72ef-41cf-ac88-a6d678f0fb09', 'mac_address': 'fa:16:3e:a2:9b:c1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 188, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:22:25.194501 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-9526bb51-7aae-4fb6-8660-ef1575a75a29 req-0b8b3dc2-7190-4b1e-99f0-8c28bd54bbd3 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0494533 Nov 08 16:22:25.203237 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:25.216773 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b3094cea-72ef-41cf-ac88-a6d678f0fb09 {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:22:25.237457 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port b3094cea-72ef-41cf-ac88-a6d678f0fb09, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=b3094cea-72ef-41cf-ac88-a6d678f0fb09,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:22:25.241202 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:25.294058 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=b3094cea-72ef-41cf-ac88-a6d678f0fb09,revision_number=9']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:22:25.301026 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:25.301406 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:25.301765 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:25.302102 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:25.302428 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:25.302754 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:25.303080 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:25.303401 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:25.303724 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:25.304040 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:25.304356 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:25.304672 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:25.667688 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['b3094cea-72ef-41cf-ac88-a6d678f0fb09'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:22:26.015816 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-763869e4-b50c-4f78-b537-f9624d5fd6d6 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:26.017480 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-763869e4-b50c-4f78-b537-f9624d5fd6d6 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.25 "GET /v2.0/networks?id=f9b0f22e-a782-44ad-bfe0-8de1f795305e HTTP/1.1" status: 200 len: 809 time: 0.1021831 Nov 08 16:22:26.049630 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c97ca7d6-9dba-452c-81f3-93ff4fadaced req-cd2c1a96-c7ce-4093-aadf-27ab511546d3 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 210 time: 0.0299363 Nov 08 16:22:26.095841 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-9bd4b785-4bc0-4a9b-89aa-01b29f20a756 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.25 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=71b067e1fbac491a8e16a4ba91049db9 HTTP/1.1" status: 200 len: 380 time: 0.0667593 Nov 08 16:22:26.105446 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Request body: {'port': {'device_id': '8472eae0-c7a0-4a09-855d-0d96cce75e92', 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e', 'admin_state_up': True, 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'security_groups': ['da359123-5a1e-4b60-8d5a-f50c1ee0c53b']}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:22:26.209680 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Made reservation on behalf of 71b067e1fbac491a8e16a4ba91049db9 for: {'port': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:22:26.213185 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:26.362296 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-608aee7e-502d-48ea-9d87-3477c1deebf6 req-46f1142c-e707-48bd-9ee4-2e73c5a5dc51 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:26.363898 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-608aee7e-502d-48ea-9d87-3477c1deebf6 req-46f1142c-e707-48bd-9ee4-2e73c5a5dc51 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 945 time: 0.0951765 Nov 08 16:22:26.373597 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Allocated IP 172.20.0.10 (f9b0f22e-a782-44ad-bfe0-8de1f795305e/67fc8ce5-82b1-4d6d-bf54-e59b246e08c9/e8c812be-3317-46f0-9044-f415824262be) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:22:26.441417 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-608aee7e-502d-48ea-9d87-3477c1deebf6 req-93eb2a23-9558-400e-8045-5705e7e8edbf tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0689957 Nov 08 16:22:26.542354 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:26.573456 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:26.614386 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Network f9b0f22e-a782-44ad-bfe0-8de1f795305e is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:22:26.619621 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:22:26.623247 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:22:26.629624 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Pushing event updated for resources: {'Port': ['ID=e8c812be-3317-46f0-9044-f415824262be,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:22:26.656882 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:26.657222 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:26.657588 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:26.658565 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:26.658886 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:26.659206 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:26.659521 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:26.659840 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:26.660154 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:26.660467 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:26.660791 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:26.661086 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:26.686792 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:26.687403 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:26.703531 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-0cfa4f9b-7cbe-4d89-b973-7e9e7daf6857 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6015105 Nov 08 16:22:26.716778 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-2a7d0ccb-f173-42b6-9ada-f59c572307a6 service neutron] Request body: {'port': {'device_id': '8472eae0-c7a0-4a09-855d-0d96cce75e92', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81618'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:22:26.775092 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-2a7d0ccb-f173-42b6-9ada-f59c572307a6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:26.795173 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-037d28fd-345b-4f7a-a7a7-791b77a1c3af None None] Provisioning complete for port e8c812be-3317-46f0-9044-f415824262be triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:22:26.795747 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-037d28fd-345b-4f7a-a7a7-791b77a1c3af None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:26.830970 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-037d28fd-345b-4f7a-a7a7-791b77a1c3af None None] Port e8c812be-3317-46f0-9044-f415824262be cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:22:27.028950 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-2a7d0ccb-f173-42b6-9ada-f59c572307a6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e8c812be-3317-46f0-9044-f415824262be {{(pid=101244) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:22:27.036709 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-2a7d0ccb-f173-42b6-9ada-f59c572307a6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:27.050348 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.provisioning_blocks [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-2a7d0ccb-f173-42b6-9ada-f59c572307a6 service neutron] Transition to ACTIVE for port object e8c812be-3317-46f0-9044-f415824262be will not be triggered until provisioned by entity L2. {{(pid=101244) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 16:22:27.050534 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device b3094cea-72ef-41cf-ac88-a6d678f0fb09 up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:22:27.054292 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-2a7d0ccb-f173-42b6-9ada-f59c572307a6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:27.103557 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port b3094cea-72ef-41cf-ac88-a6d678f0fb09 triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:22:27.104163 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:27.143640 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a7d0ccb-f173-42b6-9ada-f59c572307a6 service neutron] Pushing event updated for resources: {'Port': ['ID=e8c812be-3317-46f0-9044-f415824262be,revision_number=2']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:22:27.199218 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:27.226848 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-896b364c-e369-4e20-b1e5-45ae8bf62f5f req-e807e512-b2f6-4e55-93b5-49f0b58c11ba tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:27.233484 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f0c4ded0-3419-458b-ab12-da310a2b2fd7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b3094cea-72ef-41cf-ac88-a6d678f0fb09'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:22:27.233846 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-896b364c-e369-4e20-b1e5-45ae8bf62f5f req-e807e512-b2f6-4e55-93b5-49f0b58c11ba tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 944 time: 0.1014798 Nov 08 16:22:27.235022 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f80dd0c2-3887-43e5-bdd0-b93575569af6" -d '{"events": [{"server_uuid": "f0c4ded0-3419-458b-ab12-da310a2b2fd7", "name": "network-vif-plugged", "status": "completed", "tag": "b3094cea-72ef-41cf-ac88-a6d678f0fb09"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:22:27.242982 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-2a7d0ccb-f173-42b6-9ada-f59c572307a6 service neutron] Attempting to bind port e8c812be-3317-46f0-9044-f415824262be on host hv-cinder-81618 for vnic_type normal with profile {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:22:27.243318 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-2a7d0ccb-f173-42b6-9ada-f59c572307a6 service neutron] Attempting to bind port e8c812be-3317-46f0-9044-f415824262be by drivers openvswitch,hyperv on host hv-cinder-81618 at level 0 using segments [{'id': 'd3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e'}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:22:27.243625 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-2a7d0ccb-f173-42b6-9ada-f59c572307a6 service neutron] Attempting to bind port e8c812be-3317-46f0-9044-f415824262be on network f9b0f22e-a782-44ad-bfe0-8de1f795305e {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:22:27.249008 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port b3094cea-72ef-41cf-ac88-a6d678f0fb09, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=b3094cea-72ef-41cf-ac88-a6d678f0fb09,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:22:27.254967 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:27.276596 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-2a7d0ccb-f173-42b6-9ada-f59c572307a6 service neutron] Port e8c812be-3317-46f0-9044-f415824262be on network f9b0f22e-a782-44ad-bfe0-8de1f795305e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81618 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 16:22:27.277309 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-2a7d0ccb-f173-42b6-9ada-f59c572307a6 service neutron] Attempting to bind port e8c812be-3317-46f0-9044-f415824262be on network f9b0f22e-a782-44ad-bfe0-8de1f795305e {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:22:27.303139 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-2a7d0ccb-f173-42b6-9ada-f59c572307a6 service neutron] Checking agent: {'id': '54bf9779-c14d-412a-90fc-96b4a6589d5a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81618', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'started_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 22, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:22:27.303853 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-2a7d0ccb-f173-42b6-9ada-f59c572307a6 service neutron] Checking segment: {'id': 'd3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:22:27.304315 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-2a7d0ccb-f173-42b6-9ada-f59c572307a6 service neutron] Bound using segment: {'id': 'd3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e'} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:22:27.304852 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-2a7d0ccb-f173-42b6-9ada-f59c572307a6 service neutron] Bound port: e8c812be-3317-46f0-9044-f415824262be, host: hv-cinder-81618, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e'}}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:22:27.305279 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-2a7d0ccb-f173-42b6-9ada-f59c572307a6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:27.315545 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=b3094cea-72ef-41cf-ac88-a6d678f0fb09,revision_number=10']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:22:27.339088 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-896b364c-e369-4e20-b1e5-45ae8bf62f5f req-508955f1-8564-4f29-99ee-bcab2fe7fe64 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1041305 Nov 08 16:22:27.384090 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:22:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-92e6fcfe-ac41-48a8-9a05-c641373c856f x-openstack-request-id: req-92e6fcfe-ac41-48a8-9a05-c641373c856f {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:22:27.384868 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f0c4ded0-3419-458b-ab12-da310a2b2fd7", "name": "network-vif-plugged", "status": "completed", "tag": "b3094cea-72ef-41cf-ac88-a6d678f0fb09", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:22:27.385125 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-92e6fcfe-ac41-48a8-9a05-c641373c856f {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:22:27.385689 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f0c4ded0-3419-458b-ab12-da310a2b2fd7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b3094cea-72ef-41cf-ac88-a6d678f0fb09', 'code': 200} Nov 08 16:22:27.411403 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-2a7d0ccb-f173-42b6-9ada-f59c572307a6 service neutron] For port e8c812be-3317-46f0-9044-f415824262be, host hv-cinder-81618, cleared binding levels {{(pid=101244) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:22:27.414792 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-2a7d0ccb-f173-42b6-9ada-f59c572307a6 service neutron] For port e8c812be-3317-46f0-9044-f415824262be, host hv-cinder-81618, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=e8c812be-3317-46f0-9044-f415824262be,segment=NetworkSegment(d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c),segment_id=d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c)] {{(pid=101244) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:22:27.418850 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-2a7d0ccb-f173-42b6-9ada-f59c572307a6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:27.453258 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-2a7d0ccb-f173-42b6-9ada-f59c572307a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:27.453771 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-2a7d0ccb-f173-42b6-9ada-f59c572307a6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:27.455708 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-2a7d0ccb-f173-42b6-9ada-f59c572307a6 service neutron] 10.222.0.25 "PUT /v2.0/ports/e8c812be-3317-46f0-9044-f415824262be HTTP/1.1" status: 200 len: 1094 time: 0.7431881 Nov 08 16:22:27.456159 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8472eae0-c7a0-4a09-855d-0d96cce75e92', 'tag': 'e8c812be-3317-46f0-9044-f415824262be'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:22:27.458455 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-16101c36-6531-4442-bac1-6efe676395c0" -d '{"events": [{"name": "network-changed", "server_uuid": "8472eae0-c7a0-4a09-855d-0d96cce75e92", "tag": "e8c812be-3317-46f0-9044-f415824262be"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:22:27.485017 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a7d0ccb-f173-42b6-9ada-f59c572307a6 service neutron] Pushing event updated for resources: {'Port': ['ID=e8c812be-3317-46f0-9044-f415824262be,revision_number=3']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:22:27.537686 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:22:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-391cf40f-ac14-4b15-be25-7aecdeb5623f x-openstack-request-id: req-391cf40f-ac14-4b15-be25-7aecdeb5623f {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:22:27.538517 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8472eae0-c7a0-4a09-855d-0d96cce75e92", "tag": "e8c812be-3317-46f0-9044-f415824262be", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:22:27.539024 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-391cf40f-ac14-4b15-be25-7aecdeb5623f {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:22:27.539643 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8472eae0-c7a0-4a09-855d-0d96cce75e92', 'tag': 'e8c812be-3317-46f0-9044-f415824262be', 'status': 'completed', 'code': 200} Nov 08 16:22:27.679598 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-322588c6-5238-4e69-b8f7-0cb22f8ed53c req-af4388a8-980c-468f-80cb-9b51fd53cdeb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:27.681268 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-322588c6-5238-4e69-b8f7-0cb22f8ed53c req-af4388a8-980c-468f-80cb-9b51fd53cdeb service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 1100 time: 0.0479059 Nov 08 16:22:27.688554 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-211afd62-22e9-4371-9d1a-20ca7e67e053 req-516b2f1e-0872-45e9-9513-a6d06dbbe278 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:27.691017 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-211afd62-22e9-4371-9d1a-20ca7e67e053 req-516b2f1e-0872-45e9-9513-a6d06dbbe278 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 947 time: 0.1027248 Nov 08 16:22:27.698188 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-17b68dd2-bde3-4b8c-8c19-1313170bdfd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:27.700062 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-17b68dd2-bde3-4b8c-8c19-1313170bdfd1 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=71b067e1fbac491a8e16a4ba91049db9&device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 1097 time: 0.0947118 Nov 08 16:22:27.739196 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-322588c6-5238-4e69-b8f7-0cb22f8ed53c req-ea1e4117-0fac-4616-8cb0-8497ee72c3fc service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0485137 Nov 08 16:22:27.755413 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-2b4b3d57-4640-4cb1-a095-b438aa39f486 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=e8c812be-3317-46f0-9044-f415824262be HTTP/1.1" status: 200 len: 217 time: 0.0459721 Nov 08 16:22:27.781530 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-211afd62-22e9-4371-9d1a-20ca7e67e053 req-c48445f6-2c4e-46b8-ac1a-b2a8f112b69d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0803339 Nov 08 16:22:28.152254 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-bb56c0a0-94c4-4429-a993-12c2f1f4509c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:28.153649 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-bb56c0a0-94c4-4429-a993-12c2f1f4509c service neutron] 10.222.0.25 "GET /v2.0/subnets?id=67fc8ce5-82b1-4d6d-bf54-e59b246e08c9 HTTP/1.1" status: 200 len: 848 time: 0.0501852 Nov 08 16:22:28.205169 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-470ba4a0-0860-49c0-b40f-f22ffad867ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:28.206687 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-470ba4a0-0860-49c0-b40f-f22ffad867ac service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=f9b0f22e-a782-44ad-bfe0-8de1f795305e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0453055 Nov 08 16:22:28.312311 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-af0c6bbc-4b13-4849-ac51-6834aaefb649 service neutron] 10.222.0.25 "GET /v2.0/networks/f9b0f22e-a782-44ad-bfe0-8de1f795305e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0951004 Nov 08 16:22:28.469627 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ce46d424-96fb-485a-ba78-6a8eab98b795 req-6c6f8d30-533f-498c-910a-533d17914671 service neutron] 10.222.0.25 "GET /v2.0/networks/f9b0f22e-a782-44ad-bfe0-8de1f795305e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1227839 Nov 08 16:22:28.486099 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-430288a6-49b4-4b8a-92e6-9d2a105f1b6d req-9be3b228-be31-477f-aec6-25fec4ef8bda tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:28.488183 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-430288a6-49b4-4b8a-92e6-9d2a105f1b6d req-9be3b228-be31-477f-aec6-25fec4ef8bda tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 944 time: 0.0728638 Nov 08 16:22:28.539422 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-430288a6-49b4-4b8a-92e6-9d2a105f1b6d req-967f6685-b4ba-48d5-b0a3-4779446386e3 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449564 Nov 08 16:22:28.579396 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16101c36-6531-4442-bac1-6efe676395c0 req-d9c46b4b-28a7-45e1-9f90-356fb402e981 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:28.581407 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-16101c36-6531-4442-bac1-6efe676395c0 req-d9c46b4b-28a7-45e1-9f90-356fb402e981 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=71b067e1fbac491a8e16a4ba91049db9&device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 1097 time: 0.0387788 Nov 08 16:22:28.671024 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16101c36-6531-4442-bac1-6efe676395c0 req-51c58155-e434-4ebb-ad9f-e5759df18527 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:28.672555 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-16101c36-6531-4442-bac1-6efe676395c0 req-51c58155-e434-4ebb-ad9f-e5759df18527 service neutron] 10.222.0.25 "GET /v2.0/networks?id=f9b0f22e-a782-44ad-bfe0-8de1f795305e HTTP/1.1" status: 200 len: 910 time: 0.0831985 Nov 08 16:22:28.713619 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-16101c36-6531-4442-bac1-6efe676395c0 req-13557e52-ecd6-4d30-9189-5624a3e23efb service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=e8c812be-3317-46f0-9044-f415824262be HTTP/1.1" status: 200 len: 217 time: 0.0330245 Nov 08 16:22:28.762057 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16101c36-6531-4442-bac1-6efe676395c0 req-1622c872-68d7-4223-a3b1-4a9a0da2e990 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:28.763443 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-16101c36-6531-4442-bac1-6efe676395c0 req-1622c872-68d7-4223-a3b1-4a9a0da2e990 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=67fc8ce5-82b1-4d6d-bf54-e59b246e08c9 HTTP/1.1" status: 200 len: 848 time: 0.0414138 Nov 08 16:22:28.808989 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16101c36-6531-4442-bac1-6efe676395c0 req-08184034-9b66-4247-b73f-b7c533cb64e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:28.810453 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-16101c36-6531-4442-bac1-6efe676395c0 req-08184034-9b66-4247-b73f-b7c533cb64e3 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=f9b0f22e-a782-44ad-bfe0-8de1f795305e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0401592 Nov 08 16:22:29.164428 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-510a865c-a5f7-4c4a-8ac6-a8181d677c4e req-0fa76a9d-31b0-4f3e-9d5c-312360969fab tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:29.165958 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-510a865c-a5f7-4c4a-8ac6-a8181d677c4e req-0fa76a9d-31b0-4f3e-9d5c-312360969fab tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 947 time: 0.3092892 Nov 08 16:22:29.168089 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-16101c36-6531-4442-bac1-6efe676395c0 req-eef2c083-92a3-4a7b-b2c5-993f1ea2cd69 service neutron] 10.222.0.25 "GET /v2.0/networks/f9b0f22e-a782-44ad-bfe0-8de1f795305e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3499544 Nov 08 16:22:29.259852 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-510a865c-a5f7-4c4a-8ac6-a8181d677c4e req-49ae251f-af9a-4561-b420-e74f2f074383 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0878875 Nov 08 16:22:29.285377 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-16101c36-6531-4442-bac1-6efe676395c0 req-18b26c3f-182e-488a-8e56-9ea318679e94 service neutron] 10.222.0.25 "GET /v2.0/networks/f9b0f22e-a782-44ad-bfe0-8de1f795305e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1074016 Nov 08 16:22:29.662866 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6a289f8-cd7e-4b8d-adaf-fb508bfef923 req-55bf8095-aa68-42d6-bca5-c88d408a550a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:29.664409 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e6a289f8-cd7e-4b8d-adaf-fb508bfef923 req-55bf8095-aa68-42d6-bca5-c88d408a550a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 944 time: 0.0574057 Nov 08 16:22:29.731594 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e6a289f8-cd7e-4b8d-adaf-fb508bfef923 req-014f00e0-566f-4a70-934e-54a7544c22e3 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0488670 Nov 08 16:22:30.379511 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bc34206-6ba2-4627-9c56-47df28af9e31 req-6ca87fa4-36af-49c9-b242-261618da2a72 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:30.380939 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6bc34206-6ba2-4627-9c56-47df28af9e31 req-6ca87fa4-36af-49c9-b242-261618da2a72 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 947 time: 0.0472739 Nov 08 16:22:30.430553 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6bc34206-6ba2-4627-9c56-47df28af9e31 req-3ed51678-fcad-456d-82f6-9eb9e1ddd480 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431008 Nov 08 16:22:30.847014 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5880f942-47b7-4bb9-b9a5-abf691bb73f9 req-6aaca559-c9e1-430d-a2a4-e9df4742f690 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:30.848455 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5880f942-47b7-4bb9-b9a5-abf691bb73f9 req-6aaca559-c9e1-430d-a2a4-e9df4742f690 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 944 time: 0.0464475 Nov 08 16:22:30.898715 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5880f942-47b7-4bb9-b9a5-abf691bb73f9 req-4ccb8cce-1920-4d5d-9e61-bf1ef15c103b tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444331 Nov 08 16:22:32.009067 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87de5b44-b764-4eed-9e69-bd5ce7b9e6b1 req-819241e0-cc2b-4ac9-9073-dc02df703a78 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:32.010521 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-87de5b44-b764-4eed-9e69-bd5ce7b9e6b1 req-819241e0-cc2b-4ac9-9073-dc02df703a78 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 944 time: 0.0467739 Nov 08 16:22:32.057583 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-87de5b44-b764-4eed-9e69-bd5ce7b9e6b1 req-3d2420d0-029d-468d-8739-a8602d347339 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413077 Nov 08 16:22:33.169791 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f255e2d1-dd08-4c83-a72e-04716d594490 req-6f82eeee-ddd8-43e0-be6c-b65fa850322e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:33.171234 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f255e2d1-dd08-4c83-a72e-04716d594490 req-6f82eeee-ddd8-43e0-be6c-b65fa850322e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 944 time: 0.0486495 Nov 08 16:22:33.218509 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f255e2d1-dd08-4c83-a72e-04716d594490 req-35847c61-235d-4774-afe6-6f01f2224aad tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414670 Nov 08 16:22:34.331930 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6cd5db7-6498-46a0-a3a2-a415af73b648 req-1ee2d47e-5e50-45de-81e9-a72ee8757254 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:34.333360 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f6cd5db7-6498-46a0-a3a2-a415af73b648 req-1ee2d47e-5e50-45de-81e9-a72ee8757254 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 944 time: 0.0498197 Nov 08 16:22:34.380922 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-f6cd5db7-6498-46a0-a3a2-a415af73b648 req-699d64a5-a564-4cb5-bc49-aa60c87e10e8 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415926 Nov 08 16:22:35.491708 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c205132e-3eed-4ff5-87fb-66a164670571 req-1be1f9aa-d9a2-47f8-9742-db3f5cfa3c3f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:35.493416 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c205132e-3eed-4ff5-87fb-66a164670571 req-1be1f9aa-d9a2-47f8-9742-db3f5cfa3c3f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 944 time: 0.0470433 Nov 08 16:22:35.540638 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-c205132e-3eed-4ff5-87fb-66a164670571 req-23022f3e-4ff3-4115-b7c1-acb225a9360b tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414534 Nov 08 16:22:36.654821 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e06ef49-3247-4e44-b7a4-93c25d5ceea9 req-77514f50-effe-4309-b609-33f48abc99dc tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:36.656264 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6e06ef49-3247-4e44-b7a4-93c25d5ceea9 req-77514f50-effe-4309-b609-33f48abc99dc tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 944 time: 0.0511549 Nov 08 16:22:36.704335 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6e06ef49-3247-4e44-b7a4-93c25d5ceea9 req-d0c65358-5af1-4ae4-b3d8-037301ad3f77 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413148 Nov 08 16:22:37.082553 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device e8c812be-3317-46f0-9044-f415824262be details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:22:37.177652 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port e8c812be-3317-46f0-9044-f415824262be, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=e8c812be-3317-46f0-9044-f415824262be,segment=NetworkSegment(d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c),segment_id=d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:22:37.188276 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': 'e8c812be-3317-46f0-9044-f415824262be', 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e', 'port_id': 'e8c812be-3317-46f0-9044-f415824262be', 'mac_address': 'fa:16:3e:9e:7b:a0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 190, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:22:37.224088 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:37.236021 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e8c812be-3317-46f0-9044-f415824262be {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:22:37.254196 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port e8c812be-3317-46f0-9044-f415824262be, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=e8c812be-3317-46f0-9044-f415824262be,segment=NetworkSegment(d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c),segment_id=d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:22:37.257892 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:37.306567 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=e8c812be-3317-46f0-9044-f415824262be,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:22:37.679329 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['e8c812be-3317-46f0-9044-f415824262be'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:22:37.818971 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a412f190-d377-426e-a12c-1b002c3c5e17 req-7274d5be-2894-4219-afc2-cd04ae74ae94 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:37.820570 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a412f190-d377-426e-a12c-1b002c3c5e17 req-7274d5be-2894-4219-afc2-cd04ae74ae94 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 945 time: 0.0491276 Nov 08 16:22:37.868368 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a412f190-d377-426e-a12c-1b002c3c5e17 req-118bd180-c58a-40b4-8b89-3884e125e691 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418575 Nov 08 16:22:38.131504 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-90eb8868-2096-4949-a1fc-9dfbd96c60dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:38.985368 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8cfc513-fe84-46a0-8245-2d7f5f9458ca req-8ecc9452-4f73-47e6-91ef-2b95c0ec0af3 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:38.986917 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e8cfc513-fe84-46a0-8245-2d7f5f9458ca req-8ecc9452-4f73-47e6-91ef-2b95c0ec0af3 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 945 time: 0.0483615 Nov 08 16:22:39.042767 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e8cfc513-fe84-46a0-8245-2d7f5f9458ca req-443bd3b1-7964-47f9-a8e0-1f8e7463ca0f tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474174 Nov 08 16:22:39.091704 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device e8c812be-3317-46f0-9044-f415824262be up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:22:39.139383 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning for port e8c812be-3317-46f0-9044-f415824262be completed by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 16:22:39.143320 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port e8c812be-3317-46f0-9044-f415824262be triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:22:39.143682 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:39.220811 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:39.241645 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8472eae0-c7a0-4a09-855d-0d96cce75e92', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e8c812be-3317-46f0-9044-f415824262be'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:22:39.244116 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-90671e69-9d94-4aaf-94e0-80d21d66b4e3" -d '{"events": [{"server_uuid": "8472eae0-c7a0-4a09-855d-0d96cce75e92", "name": "network-vif-plugged", "status": "completed", "tag": "e8c812be-3317-46f0-9044-f415824262be"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:22:39.257167 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port e8c812be-3317-46f0-9044-f415824262be, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=e8c812be-3317-46f0-9044-f415824262be,segment=NetworkSegment(d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c),segment_id=d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:22:39.261112 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:39.283757 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:22:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cd5d81d6-a0b2-4d83-a015-8b06e701027a x-openstack-request-id: req-cd5d81d6-a0b2-4d83-a015-8b06e701027a {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:22:39.284038 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8472eae0-c7a0-4a09-855d-0d96cce75e92", "name": "network-vif-plugged", "status": "completed", "tag": "e8c812be-3317-46f0-9044-f415824262be", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:22:39.284285 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-cd5d81d6-a0b2-4d83-a015-8b06e701027a {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:22:39.284662 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8472eae0-c7a0-4a09-855d-0d96cce75e92', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e8c812be-3317-46f0-9044-f415824262be', 'code': 200} Nov 08 16:22:39.311585 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=e8c812be-3317-46f0-9044-f415824262be,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:22:39.506491 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-676269c9-e223-45a0-ae26-8eaab477645a req-6426f1cd-806e-49f5-9efc-dd366bde1c1b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:39.508136 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-676269c9-e223-45a0-ae26-8eaab477645a req-6426f1cd-806e-49f5-9efc-dd366bde1c1b service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 1099 time: 0.0388136 Nov 08 16:22:39.552862 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-676269c9-e223-45a0-ae26-8eaab477645a req-cad6c0c2-1cfd-4d17-a5fa-82148978eea9 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0376077 Nov 08 16:22:40.155983 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87c0c096-7fcd-40c0-8f95-56dcce6d9085 req-2cfffa69-d9bc-464d-9637-610bef884cb2 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:40.157426 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-87c0c096-7fcd-40c0-8f95-56dcce6d9085 req-2cfffa69-d9bc-464d-9637-610bef884cb2 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 946 time: 0.0482655 Nov 08 16:22:40.204188 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-87c0c096-7fcd-40c0-8f95-56dcce6d9085 req-76787967-d789-48a2-bea2-7139d8a9fe7c tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403459 Nov 08 16:22:40.603893 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-e364162f-7b1f-4b5b-ba0e-9b7b82337fe5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:41.321180 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a53460-395d-4c88-a0a6-061a3e50e015 req-061835ca-be21-43bb-a761-cbf3430c6294 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:41.322691 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e8a53460-395d-4c88-a0a6-061a3e50e015 req-061835ca-be21-43bb-a761-cbf3430c6294 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 946 time: 0.0517111 Nov 08 16:22:41.372326 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e8a53460-395d-4c88-a0a6-061a3e50e015 req-aa2fc1eb-2b33-427b-9d64-b9973b3e8ea0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435927 Nov 08 16:22:41.493083 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1931bef6-4a5c-41eb-8c0f-764f53e5d06a req-37cbacaa-0086-438f-9471-c59940a5968a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:41.494707 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1931bef6-4a5c-41eb-8c0f-764f53e5d06a req-37cbacaa-0086-438f-9471-c59940a5968a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 946 time: 0.0565081 Nov 08 16:22:41.560853 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:41.577308 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d65a3277-5341-417c-9a37-853adea26acc req-cdb2a3aa-c2c5-4eb7-808e-a86400af18e0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:41.578817 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d65a3277-5341-417c-9a37-853adea26acc req-cdb2a3aa-c2c5-4eb7-808e-a86400af18e0 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=0c45dd64-42e8-48a5-8a86-f7ac61c15a2b HTTP/1.1" status: 200 len: 945 time: 0.0795636 Nov 08 16:22:41.583321 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1931bef6-4a5c-41eb-8c0f-764f53e5d06a req-f1ee2cc0-cec1-4cbf-8d71-f5e41eab8fbb tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0756648 Nov 08 16:22:41.605990 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 42406) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:22:41.628713 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d65a3277-5341-417c-9a37-853adea26acc req-1b68fad0-9eca-40c8-ba91-430561a04a07 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=d52a633a-858b-44ca-81af-e924516db368&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435553 Nov 08 16:22:41.688441 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-27503d5a-ee44-4ffc-92fe-80d1763ebe64 tempest-TestShelveInstance-1498162676 tempest-TestShelveInstance-1498162676-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101245) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:41.689993 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-27503d5a-ee44-4ffc-92fe-80d1763ebe64 tempest-TestShelveInstance-1498162676 tempest-TestShelveInstance-1498162676-project-admin] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 1094 time: 0.0829895 Nov 08 16:22:41.692858 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 42410) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:22:41.696932 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.v2.base [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Request body: {'floatingip': {'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'port_id': 'e8c812be-3317-46f0-9044-f415824262be', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'fixed_ip_address': '172.20.0.10'}} {{(pid=101245) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:22:41.718147 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for floatingip, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:41.812999 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:41.913957 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_common [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Allocated IP 172.27.3.161 (68f46265-b42a-49a0-8d57-f9362045cd9b/4728e4be-5a19-43c0-89cf-ced2a190645d/24df82d8-daf0-4261-9682-8203fdc8ebba) {{(pid=101245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:22:42.012656 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for port, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:42.044225 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:42.077027 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Network 68f46265-b42a-49a0-8d57-f9362045cd9b is already hosted by enough agents. {{(pid=101245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:22:42.080467 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.base_scheduler [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Resources bound (agent type, host, resource id): {{(pid=101245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:22:42.083020 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Received port after_create {{(pid=101245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:22:42.112600 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Pushing event updated for resources: {'Port': ['ID=24df82d8-daf0-4261-9682-8203fdc8ebba,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:22:42.123513 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:42.123850 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:42.124180 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:42.124501 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:42.124818 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:42.125135 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:42.125447 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:42.125779 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:42.126093 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:42.126931 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:42.127240 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:42.127547 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:22:42.450930 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:42.514009 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:42.657071 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for port, precommit_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:42.661247 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7464016'] for port, after_update {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:42.729268 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Pushing event updated for resources: {'Port': ['ID=24df82d8-daf0-4261-9682-8203fdc8ebba,revision_number=2']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:22:42.741672 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26bb9f3a-2a13-49e5-a25d-f798958d318f req-2de4b49a-9cff-418f-ab5e-de7f1b4f787b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:42.743465 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-26bb9f3a-2a13-49e5-a25d-f798958d318f req-2de4b49a-9cff-418f-ab5e-de7f1b4f787b tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=0c45dd64-42e8-48a5-8a86-f7ac61c15a2b HTTP/1.1" status: 200 len: 945 time: 0.0478899 Nov 08 16:22:42.743824 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-2032271'] for floatingip, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:42.791118 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-26bb9f3a-2a13-49e5-a25d-f798958d318f req-53988d6b-0c46-4e28-aea8-5497ad17d1c6 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=d52a633a-858b-44ca-81af-e924516db368&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414269 Nov 08 16:22:42.839753 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.db.l3_db [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Floating IP 0f10dbe9-01e2-4cd5-aabf-675e868d61a2 associated. External IP: 172.27.3.161, port: e8c812be-3317-46f0-9044-f415824262be. Nov 08 16:22:43.038583 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Router 775c558e-eb61-4b1c-80f7-d59df2812bdc has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101245) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:22:43.141066 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101245) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:22:43.150815 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d6ee5c5-f757-4aaa-a593-a59acc3271d2 None None] Sync routers for ids ['775c558e-eb61-4b1c-80f7-d59df2812bdc'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:22:43.158475 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for floatingip, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:43.159999 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d6ee5c5-f757-4aaa-a593-a59acc3271d2 None None] Routers {'775c558e-eb61-4b1c-80f7-d59df2812bdc'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:22:43.160596 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-8d6ee5c5-f757-4aaa-a593-a59acc3271d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:22:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['775c558e-eb61-4b1c-80f7-d59df2812bdc'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:22:43.184991 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-d57afffa-362d-4743-ba47-dfcc31a5148d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.4911425 Nov 08 16:22:43.185563 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8472eae0-c7a0-4a09-855d-0d96cce75e92', 'tag': 'e8c812be-3317-46f0-9044-f415824262be'}] {{(pid=101245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:22:43.187803 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9303bddee447de525cefc409d3d14f9dbe8ef1f21bfe9eb24fdef2609d4aa3c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6a11d608-0466-45bf-955a-8ee4b86b87af" -d '{"events": [{"name": "network-changed", "server_uuid": "8472eae0-c7a0-4a09-855d-0d96cce75e92", "tag": "e8c812be-3317-46f0-9044-f415824262be"}]}' {{(pid=101245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:22:43.223829 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:22:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-738cdae0-34e4-4885-8612-d8375a87516a x-openstack-request-id: req-738cdae0-34e4-4885-8612-d8375a87516a {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:22:43.224116 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8472eae0-c7a0-4a09-855d-0d96cce75e92", "tag": "e8c812be-3317-46f0-9044-f415824262be", "status": "completed", "code": 200}]} {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:22:43.224367 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-738cdae0-34e4-4885-8612-d8375a87516a {{(pid=101245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:22:43.224766 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8472eae0-c7a0-4a09-855d-0d96cce75e92', 'tag': 'e8c812be-3317-46f0-9044-f415824262be', 'status': 'completed', 'code': 200} Nov 08 16:22:43.264994 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-8d6ee5c5-f757-4aaa-a593-a59acc3271d2 None None] Set router 775c558e-eb61-4b1c-80f7-d59df2812bdc gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:22:43.293804 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a11d608-0466-45bf-955a-8ee4b86b87af req-b1a079e2-d690-4f83-b463-1c56209a6f77 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:43.295304 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6a11d608-0466-45bf-955a-8ee4b86b87af req-b1a079e2-d690-4f83-b463-1c56209a6f77 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=71b067e1fbac491a8e16a4ba91049db9&device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 1099 time: 0.0406930 Nov 08 16:22:43.315127 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:43.388509 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a11d608-0466-45bf-955a-8ee4b86b87af req-15796265-6a57-490b-95af-e39ae7925464 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:43.390046 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6a11d608-0466-45bf-955a-8ee4b86b87af req-15796265-6a57-490b-95af-e39ae7925464 service neutron] 10.222.0.25 "GET /v2.0/networks?id=f9b0f22e-a782-44ad-bfe0-8de1f795305e HTTP/1.1" status: 200 len: 910 time: 0.0864460 Nov 08 16:22:43.453603 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6a11d608-0466-45bf-955a-8ee4b86b87af req-03b54264-9fbb-4cea-9f28-2d8220112295 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=e8c812be-3317-46f0-9044-f415824262be HTTP/1.1" status: 200 len: 1000 time: 0.0560262 Nov 08 16:22:43.494843 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-8d6ee5c5-f757-4aaa-a593-a59acc3271d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'name': 'tempest-TestShelveInstance-1067069244-router', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52'}], 'enable_snat': True}, 'gw_port_id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:21:45Z', 'updated_at': '2021-11-08T16:21:49Z', 'revision_number': 4, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'gw_port': {'id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:5b:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 566, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:46Z', 'updated_at': '2021-11-08T16:21:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': '0f10dbe9-01e2-4cd5-aabf-675e868d61a2', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'floating_ip_address': '172.27.3.161', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'port_id': 'e8c812be-3317-46f0-9044-f415824262be', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 591, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e', 'mac_address': 'fa:16:3e:9e:7b:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8472eae0-c7a0-4a09-855d-0d96cce75e92', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:22:42Z', 'updated_at': '2021-11-08T16:22:42Z', 'revision_number': 0, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3a14a839-f3ee-4231-a9b5-00067b56ef01', 'name': '', 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'mac_address': 'fa:16:3e:94:f9:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'device_owner': 'network:router_interface', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:48Z', 'updated_at': '2021-11-08T16:21:55Z', 'revision_number': 5, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'subnets': [{'id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:22:43.507391 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a11d608-0466-45bf-955a-8ee4b86b87af req-8d670957-1d5a-492e-b26a-8a8ff9aa9eab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:43.508819 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6a11d608-0466-45bf-955a-8ee4b86b87af req-8d670957-1d5a-492e-b26a-8a8ff9aa9eab service neutron] 10.222.0.25 "GET /v2.0/subnets?id=67fc8ce5-82b1-4d6d-bf54-e59b246e08c9 HTTP/1.1" status: 200 len: 848 time: 0.0473208 Nov 08 16:22:43.520074 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d6ee5c5-f757-4aaa-a593-a59acc3271d2 None None] Checking router: 775c558e-eb61-4b1c-80f7-d59df2812bdc for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:22:43.528380 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d6ee5c5-f757-4aaa-a593-a59acc3271d2 None None] Routers {'775c558e-eb61-4b1c-80f7-d59df2812bdc'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:22:43.528980 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-8d6ee5c5-f757-4aaa-a593-a59acc3271d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:22:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['775c558e-eb61-4b1c-80f7-d59df2812bdc'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:22:43.555686 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a11d608-0466-45bf-955a-8ee4b86b87af req-fb11a386-bfa1-4fe7-a0e7-72fa5b9744f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:43.557058 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6a11d608-0466-45bf-955a-8ee4b86b87af req-fb11a386-bfa1-4fe7-a0e7-72fa5b9744f0 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=f9b0f22e-a782-44ad-bfe0-8de1f795305e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0383170 Nov 08 16:22:43.633614 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-8d6ee5c5-f757-4aaa-a593-a59acc3271d2 None None] Set router 775c558e-eb61-4b1c-80f7-d59df2812bdc gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:22:43.658975 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6a11d608-0466-45bf-955a-8ee4b86b87af req-6af5763b-d156-4366-98c7-654d319a493e service neutron] 10.222.0.25 "GET /v2.0/networks/f9b0f22e-a782-44ad-bfe0-8de1f795305e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0893261 Nov 08 16:22:43.763498 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6a11d608-0466-45bf-955a-8ee4b86b87af req-688014cc-3aaf-4d72-8191-5b35ef253387 service neutron] 10.222.0.25 "GET /v2.0/networks/f9b0f22e-a782-44ad-bfe0-8de1f795305e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0853722 Nov 08 16:22:43.911707 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcc12bdb-225d-4c4d-b6fd-d58b3867a905 req-b72646fa-5ef6-4460-80ca-64de9a59b117 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:43.913292 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dcc12bdb-225d-4c4d-b6fd-d58b3867a905 req-b72646fa-5ef6-4460-80ca-64de9a59b117 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=0c45dd64-42e8-48a5-8a86-f7ac61c15a2b HTTP/1.1" status: 200 len: 945 time: 0.0520122 Nov 08 16:22:43.963260 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dcc12bdb-225d-4c4d-b6fd-d58b3867a905 req-506e4c12-9e3f-4e5f-9135-ede8da5d5d63 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups?id=d52a633a-858b-44ca-81af-e924516db368&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438192 Nov 08 16:22:43.991139 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-8d6ee5c5-f757-4aaa-a593-a59acc3271d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'name': 'tempest-TestShelveInstance-1067069244-router', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52'}], 'enable_snat': True}, 'gw_port_id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:21:45Z', 'updated_at': '2021-11-08T16:21:49Z', 'revision_number': 4, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'gw_port': {'id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:5b:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 566, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:46Z', 'updated_at': '2021-11-08T16:21:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': '0f10dbe9-01e2-4cd5-aabf-675e868d61a2', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'floating_ip_address': '172.27.3.161', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'port_id': 'e8c812be-3317-46f0-9044-f415824262be', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 591, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e', 'mac_address': 'fa:16:3e:9e:7b:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8472eae0-c7a0-4a09-855d-0d96cce75e92', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:22:42Z', 'updated_at': '2021-11-08T16:22:42Z', 'revision_number': 0, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3a14a839-f3ee-4231-a9b5-00067b56ef01', 'name': '', 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'mac_address': 'fa:16:3e:94:f9:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'device_owner': 'network:router_interface', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:48Z', 'updated_at': '2021-11-08T16:21:55Z', 'revision_number': 5, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'subnets': [{'id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:22:43.994743 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:44.019480 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d6ee5c5-f757-4aaa-a593-a59acc3271d2 None None] The sync data for ids ['775c558e-eb61-4b1c-80f7-d59df2812bdc'] in dv-cinder-816187-2-iscsi is: [{'id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'name': 'tempest-TestShelveInstance-1067069244-router', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52'}], 'enable_snat': True}, 'gw_port_id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:21:45Z', 'updated_at': '2021-11-08T16:21:49Z', 'revision_number': 4, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'gw_port': {'id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:5b:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 566, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:46Z', 'updated_at': '2021-11-08T16:21:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': '0f10dbe9-01e2-4cd5-aabf-675e868d61a2', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'floating_ip_address': '172.27.3.161', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'port_id': 'e8c812be-3317-46f0-9044-f415824262be', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 591, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e', 'mac_address': 'fa:16:3e:9e:7b:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8472eae0-c7a0-4a09-855d-0d96cce75e92', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:22:42Z', 'updated_at': '2021-11-08T16:22:42Z', 'revision_number': 0, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3a14a839-f3ee-4231-a9b5-00067b56ef01', 'name': '', 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'mac_address': 'fa:16:3e:94:f9:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'device_owner': 'network:router_interface', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:48Z', 'updated_at': '2021-11-08T16:21:55Z', 'revision_number': 5, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'subnets': [{'id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:22:44.044588 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28c3c8f8-4595-4434-9f16-6c3270c773a8 req-b9f53ec2-6ec4-42b0-a111-3ed37773f7a1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:22:44.046137 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-28c3c8f8-4595-4434-9f16-6c3270c773a8 req-b9f53ec2-6ec4-42b0-a111-3ed37773f7a1 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.25 "GET /v2.0/ports?device_id=0c45dd64-42e8-48a5-8a86-f7ac61c15a2b HTTP/1.1" status: 200 len: 945 time: 0.0548620 Nov 08 16:22:44.147718 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-28c3c8f8-4595-4434-9f16-6c3270c773a8 req-f6dc5a30-fdab-4876-a694-6607e8564609 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Deleting port a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:22:44.148061 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-28c3c8f8-4595-4434-9f16-6c3270c773a8 req-f6dc5a30-fdab-4876-a694-6607e8564609 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:44.214598 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eac6b555-f3e6-475b-b683-324554a9ae84 None None] New status for floating IP 0f10dbe9-01e2-4cd5-aabf-675e868d61a2: ACTIVE {{(pid=101247) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 16:22:44.241875 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-28c3c8f8-4595-4434-9f16-6c3270c773a8 req-f6dc5a30-fdab-4876-a694-6607e8564609 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] For port a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00,segment=NetworkSegment(7651dfae-d245-4d32-b379-dc243d043404),segment_id=7651dfae-d245-4d32-b379-dc243d043404)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:22:44.242237 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-28c3c8f8-4595-4434-9f16-6c3270c773a8 req-f6dc5a30-fdab-4876-a694-6607e8564609 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:44.411177 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-28c3c8f8-4595-4434-9f16-6c3270c773a8 req-f6dc5a30-fdab-4876-a694-6607e8564609 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:44.411572 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-28c3c8f8-4595-4434-9f16-6c3270c773a8 req-f6dc5a30-fdab-4876-a694-6607e8564609 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-2032271'] for floatingip, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:44.411850 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.db.l3_db [req-28c3c8f8-4595-4434-9f16-6c3270c773a8 req-f6dc5a30-fdab-4876-a694-6607e8564609 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Floating IP 7c719750-67be-4039-9016-b5c078c41258 disassociated. External IP: 172.27.3.195, port: a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00. Nov 08 16:22:44.412185 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-28c3c8f8-4595-4434-9f16-6c3270c773a8 req-f6dc5a30-fdab-4876-a694-6607e8564609 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling delete_port for a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 owned by compute:nova {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:22:44.538167 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-28c3c8f8-4595-4434-9f16-6c3270c773a8 req-f6dc5a30-fdab-4876-a694-6607e8564609 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:44.564615 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6dc5a30-fdab-4876-a694-6607e8564609 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Pushing event deleted for resources: {'Port': ['ID=a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:22:44.674993 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.l3_agent_scheduler [req-28c3c8f8-4595-4434-9f16-6c3270c773a8 req-f6dc5a30-fdab-4876-a694-6607e8564609 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Router c3f55c44-bed1-4955-9229-dac3c412f010 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:22:44.777292 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-28c3c8f8-4595-4434-9f16-6c3270c773a8 req-f6dc5a30-fdab-4876-a694-6607e8564609 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:22:44.787516 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f1bee78-cf3b-45d4-808d-0c5473791925 None None] Sync routers for ids ['c3f55c44-bed1-4955-9229-dac3c412f010'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:22:44.796608 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f1bee78-cf3b-45d4-808d-0c5473791925 None None] Routers {'c3f55c44-bed1-4955-9229-dac3c412f010'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:22:44.797217 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-7f1bee78-cf3b-45d4-808d-0c5473791925 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:22:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['c3f55c44-bed1-4955-9229-dac3c412f010'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:22:44.814004 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-28c3c8f8-4595-4434-9f16-6c3270c773a8 req-f6dc5a30-fdab-4876-a694-6607e8564609 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] No DVR routers for this DVR port a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 on host hv-cinder-81618 {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:22:44.816565 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-28c3c8f8-4595-4434-9f16-6c3270c773a8 req-f6dc5a30-fdab-4876-a694-6607e8564609 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:44.820114 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-28c3c8f8-4595-4434-9f16-6c3270c773a8 req-f6dc5a30-fdab-4876-a694-6607e8564609 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.25 "DELETE /v2.0/ports/a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 HTTP/1.1" status: 204 len: 173 time: 0.7613258 Nov 08 16:22:44.820556 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0c45dd64-42e8-48a5-8a86-f7ac61c15a2b', 'name': 'network-vif-deleted', 'tag': 'a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:22:44.822772 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5c8e7782-75b2-4572-8be0-7784f11bc151" -d '{"events": [{"server_uuid": "0c45dd64-42e8-48a5-8a86-f7ac61c15a2b", "name": "network-vif-deleted", "tag": "a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:22:44.861372 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:22:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-812f7384-8c0f-4750-ad74-879d68b279fa x-openstack-request-id: req-812f7384-8c0f-4750-ad74-879d68b279fa {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:22:44.861657 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0c45dd64-42e8-48a5-8a86-f7ac61c15a2b", "name": "network-vif-deleted", "tag": "a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:22:44.861936 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-812f7384-8c0f-4750-ad74-879d68b279fa {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:22:44.862332 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0c45dd64-42e8-48a5-8a86-f7ac61c15a2b', 'name': 'network-vif-deleted', 'tag': 'a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00', 'status': 'completed', 'code': 200} Nov 08 16:22:44.910115 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-7f1bee78-cf3b-45d4-808d-0c5473791925 None None] Set router c3f55c44-bed1-4955-9229-dac3c412f010 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:22:45.074062 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4e4c79d3-2cda-448b-b860-ff5da10de19a req-94c6db78-5f9b-4c72-97d1-83b103e1f4ea tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/ports?device_id=0c45dd64-42e8-48a5-8a86-f7ac61c15a2b HTTP/1.1" status: 200 len: 210 time: 0.0268736 Nov 08 16:22:45.127527 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-7f1bee78-cf3b-45d4-808d-0c5473791925 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'name': 'tempest-AttachVolumeTestJSON-272347721-router', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128'}], 'enable_snat': True}, 'gw_port_id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 4, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'gw_port': {'id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:97:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '30759480-5159-4b6e-a269-86ac7d105870', 'name': '', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'mac_address': 'fa:16:3e:86:ee:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:13Z', 'updated_at': '2021-11-08T16:11:28Z', 'revision_number': 5, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'subnets': [{'id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:22:45.153134 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f1bee78-cf3b-45d4-808d-0c5473791925 None None] Checking router: c3f55c44-bed1-4955-9229-dac3c412f010 for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:22:45.161127 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f1bee78-cf3b-45d4-808d-0c5473791925 None None] Routers {'c3f55c44-bed1-4955-9229-dac3c412f010'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:22:45.161666 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-7f1bee78-cf3b-45d4-808d-0c5473791925 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:22:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['c3f55c44-bed1-4955-9229-dac3c412f010'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:22:45.263262 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-7f1bee78-cf3b-45d4-808d-0c5473791925 None None] Set router c3f55c44-bed1-4955-9229-dac3c412f010 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:22:45.464744 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-7f1bee78-cf3b-45d4-808d-0c5473791925 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'name': 'tempest-AttachVolumeTestJSON-272347721-router', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128'}], 'enable_snat': True}, 'gw_port_id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 4, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'gw_port': {'id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:97:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '30759480-5159-4b6e-a269-86ac7d105870', 'name': '', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'mac_address': 'fa:16:3e:86:ee:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:13Z', 'updated_at': '2021-11-08T16:11:28Z', 'revision_number': 5, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'subnets': [{'id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:22:45.494092 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f1bee78-cf3b-45d4-808d-0c5473791925 None None] The sync data for ids ['c3f55c44-bed1-4955-9229-dac3c412f010'] in dv-cinder-816187-2-iscsi is: [{'id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'name': 'tempest-AttachVolumeTestJSON-272347721-router', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128'}], 'enable_snat': True}, 'gw_port_id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 4, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'gw_port': {'id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:97:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '30759480-5159-4b6e-a269-86ac7d105870', 'name': '', 'network_id': '75fa9c3e-7bfe-490a-9118-221394c29646', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'mac_address': 'fa:16:3e:86:ee:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:13Z', 'updated_at': '2021-11-08T16:11:28Z', 'revision_number': 5, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'subnets': [{'id': '8b248e51-4c70-4980-9452-c6b625bf96dd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:22:45.703664 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4860fcd9-176b-49d9-bb81-46c90c76546c None None] New status for floating IP 7c719750-67be-4039-9016-b5c078c41258: DOWN {{(pid=101247) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 16:22:46.158463 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 42430) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:22:46.210720 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-05073868-8536-4000-bc58-0ff1fde50b1d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:46.232204 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-05073868-8536-4000-bc58-0ff1fde50b1d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:46.280418 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-05073868-8536-4000-bc58-0ff1fde50b1d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:46.283341 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-05073868-8536-4000-bc58-0ff1fde50b1d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:46.284445 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-05073868-8536-4000-bc58-0ff1fde50b1d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "DELETE /v2.0/security-groups/d52a633a-858b-44ca-81af-e924516db368 HTTP/1.1" status: 204 len: 168 time: 0.1249466 Nov 08 16:22:46.287328 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 42432) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:22:46.293207 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05073868-8536-4000-bc58-0ff1fde50b1d tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d52a633a-858b-44ca-81af-e924516db368,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:22:46.303988 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.api.v2.resource [None req-4d8895ff-78e9-4076-b886-c3add6efb551 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] show failed (client error): The resource could not be found. Nov 08 16:22:46.305010 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-4d8895ff-78e9-4076-b886-c3add6efb551 tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "GET /v2.0/security-groups/d52a633a-858b-44ca-81af-e924516db368 HTTP/1.1" status: 404 len: 347 time: 0.0167189 Nov 08 16:22:46.307961 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 42434) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:22:46.426809 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-1bc90074-b6c8-455b-9e25-fcced96625ea tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Deleting port 3cb56f58-bc29-4444-8b73-47ccd15779fc {{(pid=101245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:22:46.427069 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1bc90074-b6c8-455b-9e25-fcced96625ea tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:46.498183 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1bc90074-b6c8-455b-9e25-fcced96625ea tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:46.498492 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1bc90074-b6c8-455b-9e25-fcced96625ea tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:46.510392 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-1bc90074-b6c8-455b-9e25-fcced96625ea tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Calling delete_port for 3cb56f58-bc29-4444-8b73-47ccd15779fc owned by network:floatingip {{(pid=101245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:22:46.633496 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1bc90074-b6c8-455b-9e25-fcced96625ea tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:46.657283 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bc90074-b6c8-455b-9e25-fcced96625ea tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Pushing event deleted for resources: {'Port': ['ID=3cb56f58-bc29-4444-8b73-47ccd15779fc,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:22:46.716239 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1bc90074-b6c8-455b-9e25-fcced96625ea tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks [] for floatingip, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:46.718698 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1bc90074-b6c8-455b-9e25-fcced96625ea tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for floatingip, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:46.719810 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-1bc90074-b6c8-455b-9e25-fcced96625ea tempest-AttachVolumeTestJSON-267365066 tempest-AttachVolumeTestJSON-267365066-project] 10.222.0.37 "DELETE /v2.0/floatingips/7c719750-67be-4039-9016-b5c078c41258 HTTP/1.1" status: 204 len: 168 time: 0.4109662 Nov 08 16:22:47.141102 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:22:47.161524 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] No Port match for: a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:22:47.161909 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device a873fbe5-2b81-40c2-ba59-9c5bd6a1ec00 not bound to the agent host hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:22:47.999492 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:50.249618 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 42466) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:22:50.669813 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a6640c04-fa3d-49fd-b251-a63ab2fc65e4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-2033295'] for router_interface, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:50.900058 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-a6640c04-fa3d-49fd-b251-a63ab2fc65e4 admin admin] Deleting port 30759480-5159-4b6e-a269-86ac7d105870 {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:22:50.900369 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a6640c04-fa3d-49fd-b251-a63ab2fc65e4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:50.976399 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [None req-a6640c04-fa3d-49fd-b251-a63ab2fc65e4 admin admin] For port 30759480-5159-4b6e-a269-86ac7d105870, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=30759480-5159-4b6e-a269-86ac7d105870,segment=NetworkSegment(7651dfae-d245-4d32-b379-dc243d043404),segment_id=7651dfae-d245-4d32-b379-dc243d043404)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:22:50.976663 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a6640c04-fa3d-49fd-b251-a63ab2fc65e4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:50.989040 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-a6640c04-fa3d-49fd-b251-a63ab2fc65e4 admin admin] Calling delete_port for 30759480-5159-4b6e-a269-86ac7d105870 owned by network:router_interface {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:22:51.392546 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a6640c04-fa3d-49fd-b251-a63ab2fc65e4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:51.417070 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6640c04-fa3d-49fd-b251-a63ab2fc65e4 admin admin] Pushing event deleted for resources: {'Port': ['ID=30759480-5159-4b6e-a269-86ac7d105870,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:22:51.576655 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a6640c04-fa3d-49fd-b251-a63ab2fc65e4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1599532', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-2034495'] for router_interface, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:51.787207 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a6640c04-fa3d-49fd-b251-a63ab2fc65e4 admin admin] Router c3f55c44-bed1-4955-9229-dac3c412f010 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:22:51.890844 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a6640c04-fa3d-49fd-b251-a63ab2fc65e4 admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:22:51.896389 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-a6640c04-fa3d-49fd-b251-a63ab2fc65e4 admin admin] 10.222.0.37 "PUT /v2.0/routers/c3f55c44-bed1-4955-9229-dac3c412f010/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6457298 Nov 08 16:22:51.898929 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 42472) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:22:51.899721 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db931d79-0ed5-4384-8231-48744aa60b7b None None] Sync routers for ids ['c3f55c44-bed1-4955-9229-dac3c412f010'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:22:51.909429 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db931d79-0ed5-4384-8231-48744aa60b7b None None] Routers {'c3f55c44-bed1-4955-9229-dac3c412f010'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:22:51.910055 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-db931d79-0ed5-4384-8231-48744aa60b7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:22:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['c3f55c44-bed1-4955-9229-dac3c412f010'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:22:51.999435 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9a4bc568-2cc4-46e5-ac0a-a33615165034 admin admin] Publish callbacks [] for router, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:52.011046 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-db931d79-0ed5-4384-8231-48744aa60b7b None None] Set router c3f55c44-bed1-4955-9229-dac3c412f010 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:22:52.099762 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9a4bc568-2cc4-46e5-ac0a-a33615165034 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:52.153914 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-9a4bc568-2cc4-46e5-ac0a-a33615165034 admin admin] Deleting port 570b0fd6-c5f9-427e-a59a-28c493e0cd78 {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:22:52.154261 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9a4bc568-2cc4-46e5-ac0a-a33615165034 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:52.185372 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-db931d79-0ed5-4384-8231-48744aa60b7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'name': 'tempest-AttachVolumeTestJSON-272347721-router', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128'}], 'enable_snat': True}, 'gw_port_id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:22:51Z', 'revision_number': 5, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'gw_port': {'id': '570b0fd6-c5f9-427e-a59a-28c493e0cd78', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:97:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:05Z', 'updated_at': '2021-11-08T16:11:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:22:52.211486 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db931d79-0ed5-4384-8231-48744aa60b7b None None] Checking router: c3f55c44-bed1-4955-9229-dac3c412f010 for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:22:52.220476 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db931d79-0ed5-4384-8231-48744aa60b7b None None] Routers {'c3f55c44-bed1-4955-9229-dac3c412f010'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:22:52.221297 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-db931d79-0ed5-4384-8231-48744aa60b7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:22:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['c3f55c44-bed1-4955-9229-dac3c412f010'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:22:52.234112 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [None req-9a4bc568-2cc4-46e5-ac0a-a33615165034 admin admin] For port 570b0fd6-c5f9-427e-a59a-28c493e0cd78, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=570b0fd6-c5f9-427e-a59a-28c493e0cd78,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:22:52.234450 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9a4bc568-2cc4-46e5-ac0a-a33615165034 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:52.247004 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-9a4bc568-2cc4-46e5-ac0a-a33615165034 admin admin] Calling delete_port for 570b0fd6-c5f9-427e-a59a-28c493e0cd78 owned by network:router_gateway {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:22:52.304664 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-db931d79-0ed5-4384-8231-48744aa60b7b None None] Set router c3f55c44-bed1-4955-9229-dac3c412f010 gateway port host: None {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:22:52.354596 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-db931d79-0ed5-4384-8231-48744aa60b7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'name': 'tempest-AttachVolumeTestJSON-272347721-router', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:22:52Z', 'revision_number': 6, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'gw_port_host': None}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:22:52.385225 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db931d79-0ed5-4384-8231-48744aa60b7b None None] The sync data for ids ['c3f55c44-bed1-4955-9229-dac3c412f010'] in dv-cinder-816187-2-iscsi is: [{'id': 'c3f55c44-bed1-4955-9229-dac3c412f010', 'name': 'tempest-AttachVolumeTestJSON-272347721-router', 'tenant_id': 'f6e779f0506643d08d984c2971d5a71c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:22:52Z', 'revision_number': 6, 'project_id': 'f6e779f0506643d08d984c2971d5a71c', 'gw_port_host': None}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:22:52.409340 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9a4bc568-2cc4-46e5-ac0a-a33615165034 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:52.437838 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a4bc568-2cc4-46e5-ac0a-a33615165034 admin admin] Pushing event deleted for resources: {'Port': ['ID=570b0fd6-c5f9-427e-a59a-28c493e0cd78,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:22:52.493807 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9a4bc568-2cc4-46e5-ac0a-a33615165034 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-2032325'] for router_gateway, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:52.579084 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9a4bc568-2cc4-46e5-ac0a-a33615165034 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-2034023', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-12866'] for router, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:52.581152 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9a4bc568-2cc4-46e5-ac0a-a33615165034 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:52.625691 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9a4bc568-2cc4-46e5-ac0a-a33615165034 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-2034044'] for router, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:52.626187 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9a4bc568-2cc4-46e5-ac0a-a33615165034 admin admin] Fanout notify agent at l3_agent the message router_deleted on router c3f55c44-bed1-4955-9229-dac3c412f010 {{(pid=101244) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 08 16:22:52.631118 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9a4bc568-2cc4-46e5-ac0a-a33615165034 admin admin] Publish callbacks [] for router, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:52.632187 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-9a4bc568-2cc4-46e5-ac0a-a33615165034 admin admin] 10.222.0.37 "DELETE /v2.0/routers/c3f55c44-bed1-4955-9229-dac3c412f010 HTTP/1.1" status: 204 len: 168 time: 0.7323351 Nov 08 16:22:52.634682 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 42474) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:22:52.678304 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_v2 [None req-f9b1291f-ffe8-4198-ba4b-c27d33f0b137 admin admin] Deleting subnet 8b248e51-4c70-4980-9452-c6b625bf96dd {{(pid=101244) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 16:22:52.681185 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f9b1291f-ffe8-4198-ba4b-c27d33f0b137 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:52.714621 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f9b1291f-ffe8-4198-ba4b-c27d33f0b137 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8047127'] for subnet, precommit_delete_associations {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:52.796918 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f9b1291f-ffe8-4198-ba4b-c27d33f0b137 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-872226'] for subnet, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:52.848475 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f9b1291f-ffe8-4198-ba4b-c27d33f0b137 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-872235', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4227786', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4279947'] for subnet, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:52.870913 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9b1291f-ffe8-4198-ba4b-c27d33f0b137 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8b248e51-4c70-4980-9452-c6b625bf96dd,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:22:52.877072 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f9b1291f-ffe8-4198-ba4b-c27d33f0b137 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for subnet, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:52.880605 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-f9b1291f-ffe8-4198-ba4b-c27d33f0b137 admin admin] 10.222.0.37 "DELETE /v2.0/subnets/8b248e51-4c70-4980-9452-c6b625bf96dd HTTP/1.1" status: 204 len: 168 time: 0.2448885 Nov 08 16:22:52.882845 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ec92e11-486e-487d-86e0-97aea55c7ec8 None None] Network 75fa9c3e-7bfe-490a-9118-221394c29646 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:22:52.882987 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 42476) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:22:52.951611 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f7f99a17-f237-4356-8014-e4e58fda0d03 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1007047'] for network, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:53.006018 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-f7f99a17-f237-4356-8014-e4e58fda0d03 admin admin] Deleting port 71c92ac9-ccca-40b1-acfe-69b3046505a6 {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:22:53.006356 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f7f99a17-f237-4356-8014-e4e58fda0d03 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:53.066244 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [None req-f7f99a17-f237-4356-8014-e4e58fda0d03 admin admin] For port 71c92ac9-ccca-40b1-acfe-69b3046505a6, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=71c92ac9-ccca-40b1-acfe-69b3046505a6,segment=NetworkSegment(7651dfae-d245-4d32-b379-dc243d043404),segment_id=7651dfae-d245-4d32-b379-dc243d043404)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:22:53.066536 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f7f99a17-f237-4356-8014-e4e58fda0d03 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:53.078640 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-f7f99a17-f237-4356-8014-e4e58fda0d03 admin admin] Calling delete_port for 71c92ac9-ccca-40b1-acfe-69b3046505a6 owned by network:dhcp {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:22:53.160136 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f7f99a17-f237-4356-8014-e4e58fda0d03 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:53.163669 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ab9f5b4-c43e-46af-af41-b6303c785368 None None] DHCP port deletion for 75fa9c3e-7bfe-490a-9118-221394c29646 request from dv-cinder-816187-2-iscsi {{(pid=101246) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 08 16:22:53.191665 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7f99a17-f237-4356-8014-e4e58fda0d03 admin admin] Pushing event deleted for resources: {'Port': ['ID=71c92ac9-ccca-40b1-acfe-69b3046505a6,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:22:53.196831 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7f99a17-f237-4356-8014-e4e58fda0d03 admin admin] No DVR routers for this DVR port 71c92ac9-ccca-40b1-acfe-69b3046505a6 on host dv-cinder-816187-2-iscsi {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:22:53.270432 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f7f99a17-f237-4356-8014-e4e58fda0d03 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-869719', 'neutron.services.segments.db._delete_segments_for_network-8792877333297'] for network, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:53.291762 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-f7f99a17-f237-4356-8014-e4e58fda0d03 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['75fa9c3e-7bfe-490a-9118-221394c29646']}} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:22:53.301885 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-f7f99a17-f237-4356-8014-e4e58fda0d03 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7651dfae-d245-4d32-b379-dc243d043404') {'for_net_delete': True} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:22:53.302183 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-f7f99a17-f237-4356-8014-e4e58fda0d03 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7651dfae-d245-4d32-b379-dc243d043404') {} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:22:53.311397 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f7f99a17-f237-4356-8014-e4e58fda0d03 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792877333818', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8047118'] for segment, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:53.324340 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f7f99a17-f237-4356-8014-e4e58fda0d03 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:53.330524 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f7f99a17-f237-4356-8014-e4e58fda0d03 admin admin] Releasing vlan 191 on physical network physnet1 to pool {{(pid=101244) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 16:22:53.330898 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f7f99a17-f237-4356-8014-e4e58fda0d03 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4227628'] for segment, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: Traceback (most recent call last): Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: timer() Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: cb(*args, **kw) Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: return func(*args, **kwargs) Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: self._notify() Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: self.callback(batched_events) Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: event.method(event) Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: return f(self, *a, **k) Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: return self._get(url).json() Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: return self.request(url, 'GET', **kwargs) Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 16:22:53.332722 dv-cinder-816187-2-iscsi neutron-server[101244]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 16:22:53.387028 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f7f99a17-f237-4356-8014-e4e58fda0d03 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-868772', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-2032313'] for network, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:53.392454 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f7f99a17-f237-4356-8014-e4e58fda0d03 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:53.395631 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-f7f99a17-f237-4356-8014-e4e58fda0d03 admin admin] 10.222.0.37 "DELETE /v2.0/networks/75fa9c3e-7bfe-490a-9118-221394c29646 HTTP/1.1" status: 204 len: 168 time: 0.5117300 Nov 08 16:22:53.407922 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7f99a17-f237-4356-8014-e4e58fda0d03 admin admin] Pushing event deleted for resources: {'Network': ['ID=75fa9c3e-7bfe-490a-9118-221394c29646,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:22:53.512953 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 42480) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:22:53.551372 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-95226c52-768f-426c-8cb8-d15e0bce0183 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=f6e779f0506643d08d984c2971d5a71c&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0372467 Nov 08 16:22:53.553783 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 42482) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:22:53.602632 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6a59ca6d-0f30-4202-bc91-8315f4b4aff1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:53.623474 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6a59ca6d-0f30-4202-bc91-8315f4b4aff1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:53.668405 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6a59ca6d-0f30-4202-bc91-8315f4b4aff1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:53.670981 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-6a59ca6d-0f30-4202-bc91-8315f4b4aff1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:53.672120 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-6a59ca6d-0f30-4202-bc91-8315f4b4aff1 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/0b450963-0861-4ed2-bd08-0b6e00ecb590 HTTP/1.1" status: 204 len: 168 time: 0.1173365 Nov 08 16:22:53.680443 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a59ca6d-0f30-4202-bc91-8315f4b4aff1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0b450963-0861-4ed2-bd08-0b6e00ecb590,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:22:53.838591 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 570b0fd6-c5f9-427e-a59a-28c493e0cd78 no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:22:53.857612 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: 570b0fd6-c5f9-427e-a59a-28c493e0cd78 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:22:53.857974 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 570b0fd6-c5f9-427e-a59a-28c493e0cd78 not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:22:53.858379 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 30759480-5159-4b6e-a269-86ac7d105870 no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:22:53.877172 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: 30759480-5159-4b6e-a269-86ac7d105870 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:22:53.877528 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 30759480-5159-4b6e-a269-86ac7d105870 not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:22:53.878014 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 71c92ac9-ccca-40b1-acfe-69b3046505a6 no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:22:53.896824 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: 71c92ac9-ccca-40b1-acfe-69b3046505a6 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:22:53.897143 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 71c92ac9-ccca-40b1-acfe-69b3046505a6 not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:22:57.286357 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 42548) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:22:57.386667 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-34375617-9321-4f3f-aab1-f23b4a622d2a admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:57.457135 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-34375617-9321-4f3f-aab1-f23b4a622d2a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:57.460825 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-34375617-9321-4f3f-aab1-f23b4a622d2a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:57.497618 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-34375617-9321-4f3f-aab1-f23b4a622d2a admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=83caa9f431f04ac89347648fe44c9fd0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2102330 Nov 08 16:22:57.498452 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34375617-9321-4f3f-aab1-f23b4a622d2a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2eeb768d-3434-4eac-9577-a37982e22756,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:22:57.500347 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 42552) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:22:57.800317 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-28181f2d-eab2-43ac-94be-cffc6128a319 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:57.819813 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-28181f2d-eab2-43ac-94be-cffc6128a319 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:57.863254 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-28181f2d-eab2-43ac-94be-cffc6128a319 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:57.865773 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-28181f2d-eab2-43ac-94be-cffc6128a319 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:22:57.866886 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-28181f2d-eab2-43ac-94be-cffc6128a319 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/2eeb768d-3434-4eac-9577-a37982e22756 HTTP/1.1" status: 204 len: 168 time: 0.3655379 Nov 08 16:22:57.874687 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28181f2d-eab2-43ac-94be-cffc6128a319 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2eeb768d-3434-4eac-9577-a37982e22756,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:01.596859 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:23:06.919190 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 42672) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:07.020968 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4003ee32-c1c2-4e75-8430-39b6e566225a admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:07.092537 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4003ee32-c1c2-4e75-8430-39b6e566225a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:07.096484 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4003ee32-c1c2-4e75-8430-39b6e566225a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:07.133930 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-4003ee32-c1c2-4e75-8430-39b6e566225a admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=8637b781552e470890f16b795708baad&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2136652 Nov 08 16:23:07.134853 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4003ee32-c1c2-4e75-8430-39b6e566225a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4d436934-28ab-49c8-919b-c9f244130b7d,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:07.136612 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 42676) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:07.183471 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-ec06e542-9036-41b6-a7a3-1da64f03923e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:07.203165 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-ec06e542-9036-41b6-a7a3-1da64f03923e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:07.252244 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-ec06e542-9036-41b6-a7a3-1da64f03923e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:07.255353 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-ec06e542-9036-41b6-a7a3-1da64f03923e admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:07.256466 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-ec06e542-9036-41b6-a7a3-1da64f03923e admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/4d436934-28ab-49c8-919b-c9f244130b7d HTTP/1.1" status: 204 len: 168 time: 0.1188445 Nov 08 16:23:07.263672 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec06e542-9036-41b6-a7a3-1da64f03923e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4d436934-28ab-49c8-919b-c9f244130b7d,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:08.135055 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-8b91fba5-591f-4cb9-97c5-9a404d679398 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:10.604591 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-152cd7bf-a36c-4bad-8ce8-0d79227a4f8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:11.470670 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 42760) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:11.565530 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:11.573131 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-2f2c8c29-c69d-49cf-b2ad-88599103ed05 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:11.643755 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-2f2c8c29-c69d-49cf-b2ad-88599103ed05 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:11.647415 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-2f2c8c29-c69d-49cf-b2ad-88599103ed05 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:11.682364 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f2c8c29-c69d-49cf-b2ad-88599103ed05 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e37e1164-16cf-4587-90d7-dddabdb69aa9,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:11.686536 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-2f2c8c29-c69d-49cf-b2ad-88599103ed05 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=46ebf457bcbd4a0d80609b998891d7ba&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2148464 Nov 08 16:23:11.689759 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 42764) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:11.735555 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a057d5d6-4cca-49f1-a60d-e7d6d6c215e2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:11.755942 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a057d5d6-4cca-49f1-a60d-e7d6d6c215e2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:11.801156 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a057d5d6-4cca-49f1-a60d-e7d6d6c215e2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:11.803769 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a057d5d6-4cca-49f1-a60d-e7d6d6c215e2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:11.804898 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-a057d5d6-4cca-49f1-a60d-e7d6d6c215e2 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/e37e1164-16cf-4587-90d7-dddabdb69aa9 HTTP/1.1" status: 204 len: 168 time: 0.1149614 Nov 08 16:23:11.812571 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a057d5d6-4cca-49f1-a60d-e7d6d6c215e2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e37e1164-16cf-4587-90d7-dddabdb69aa9,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:12.055581 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 42770) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:12.071044 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-ca36e0ad-e6dc-4c82-ad7e-e94e2432061f admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:12.143901 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-ca36e0ad-e6dc-4c82-ad7e-e94e2432061f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:12.147618 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-ca36e0ad-e6dc-4c82-ad7e-e94e2432061f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:12.183124 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca36e0ad-e6dc-4c82-ad7e-e94e2432061f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ff637177-4159-4e5a-84d8-6144e09a65db,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:12.187301 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-ca36e0ad-e6dc-4c82-ad7e-e94e2432061f admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=db3eb94d22ed450c8b20f63a96200bb8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1307189 Nov 08 16:23:12.189974 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 42772) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:12.234833 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-21a64717-62d9-4aad-b642-7b752feb265c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:12.255333 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-21a64717-62d9-4aad-b642-7b752feb265c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:12.299262 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-21a64717-62d9-4aad-b642-7b752feb265c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:12.302205 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-21a64717-62d9-4aad-b642-7b752feb265c admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:12.303321 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-21a64717-62d9-4aad-b642-7b752feb265c admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/ff637177-4159-4e5a-84d8-6144e09a65db HTTP/1.1" status: 204 len: 168 time: 0.1124806 Nov 08 16:23:12.310662 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21a64717-62d9-4aad-b642-7b752feb265c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ff637177-4159-4e5a-84d8-6144e09a65db,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:13.297558 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:13.898127 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 42828) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:13.965035 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:14.000129 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-12630f25-a20f-447d-83b8-1b455fb1d60b admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:14.073810 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-12630f25-a20f-447d-83b8-1b455fb1d60b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:14.077348 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-12630f25-a20f-447d-83b8-1b455fb1d60b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:14.114632 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-12630f25-a20f-447d-83b8-1b455fb1d60b admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=6e8b55817eba4f2abfb3d3676d4e0ee2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2154396 Nov 08 16:23:14.115466 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12630f25-a20f-447d-83b8-1b455fb1d60b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eaa7b844-118b-4f38-9990-bd1b3c939f75,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:14.117309 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 42832) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:14.164822 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6e5d0d47-42d1-4706-9bef-3d05907e71b7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:14.187496 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6e5d0d47-42d1-4706-9bef-3d05907e71b7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:14.232029 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6e5d0d47-42d1-4706-9bef-3d05907e71b7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:14.234687 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6e5d0d47-42d1-4706-9bef-3d05907e71b7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:14.235788 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-6e5d0d47-42d1-4706-9bef-3d05907e71b7 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/eaa7b844-118b-4f38-9990-bd1b3c939f75 HTTP/1.1" status: 204 len: 168 time: 0.1174133 Nov 08 16:23:14.243822 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e5d0d47-42d1-4706-9bef-3d05907e71b7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eaa7b844-118b-4f38-9990-bd1b3c939f75,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:14.482987 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 42838) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:14.496579 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7a3fe0b0-aee3-445d-9b34-ea7f9db2940b admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:14.569213 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7a3fe0b0-aee3-445d-9b34-ea7f9db2940b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:14.573225 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-7a3fe0b0-aee3-445d-9b34-ea7f9db2940b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:14.610714 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-7a3fe0b0-aee3-445d-9b34-ea7f9db2940b admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=0ae9015f7057446bb6b1a53eee8a3259&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1265483 Nov 08 16:23:14.611696 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a3fe0b0-aee3-445d-9b34-ea7f9db2940b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6e0ce381-82f9-497c-9f58-4f03242f3ff5,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:14.613380 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 42840) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:14.660367 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-41e08548-5661-4e34-ae8a-8de8aa9aeec0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:14.680447 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-41e08548-5661-4e34-ae8a-8de8aa9aeec0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:14.725721 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-41e08548-5661-4e34-ae8a-8de8aa9aeec0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:14.728282 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-41e08548-5661-4e34-ae8a-8de8aa9aeec0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:14.729389 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-41e08548-5661-4e34-ae8a-8de8aa9aeec0 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/6e0ce381-82f9-497c-9f58-4f03242f3ff5 HTTP/1.1" status: 204 len: 168 time: 0.1149130 Nov 08 16:23:14.736779 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41e08548-5661-4e34-ae8a-8de8aa9aeec0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6e0ce381-82f9-497c-9f58-4f03242f3ff5,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:16.517943 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 42912) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:16.617406 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bff63b87-10ea-4a3c-9252-b53364dd9cad admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:16.689273 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bff63b87-10ea-4a3c-9252-b53364dd9cad admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:16.692967 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bff63b87-10ea-4a3c-9252-b53364dd9cad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:16.730800 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-bff63b87-10ea-4a3c-9252-b53364dd9cad admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=0f6b47a5f82945e48985337f6a648cf1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2117882 Nov 08 16:23:16.731884 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bff63b87-10ea-4a3c-9252-b53364dd9cad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b563a5a-e9f3-480f-9061-52aac936a552,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:16.733483 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 42916) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:16.780808 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-74ebf43d-b464-484c-8b5f-2f5b6154296a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:16.801289 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-74ebf43d-b464-484c-8b5f-2f5b6154296a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:16.850161 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-74ebf43d-b464-484c-8b5f-2f5b6154296a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:16.852657 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-74ebf43d-b464-484c-8b5f-2f5b6154296a admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:16.853808 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-74ebf43d-b464-484c-8b5f-2f5b6154296a admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/1b563a5a-e9f3-480f-9061-52aac936a552 HTTP/1.1" status: 204 len: 168 time: 0.1192851 Nov 08 16:23:16.861380 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74ebf43d-b464-484c-8b5f-2f5b6154296a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b563a5a-e9f3-480f-9061-52aac936a552,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:17.104318 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 42922) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:17.117223 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-3dedf39e-f389-4838-b64b-19844fd97745 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:17.190227 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-3dedf39e-f389-4838-b64b-19844fd97745 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:17.194493 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-3dedf39e-f389-4838-b64b-19844fd97745 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:17.232014 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-3dedf39e-f389-4838-b64b-19844fd97745 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=589707269a8448bf8191d5023c1d831f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1265860 Nov 08 16:23:17.233068 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dedf39e-f389-4838-b64b-19844fd97745 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8a4005b8-6559-44af-80ac-887042ce2d97,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:17.234725 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 42924) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:17.281171 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a90b92ba-57bd-4715-bbef-d81a2b32a07c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:17.302029 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a90b92ba-57bd-4715-bbef-d81a2b32a07c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:17.346275 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a90b92ba-57bd-4715-bbef-d81a2b32a07c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:17.348744 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a90b92ba-57bd-4715-bbef-d81a2b32a07c admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:17.349904 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-a90b92ba-57bd-4715-bbef-d81a2b32a07c admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/8a4005b8-6559-44af-80ac-887042ce2d97 HTTP/1.1" status: 204 len: 168 time: 0.1141002 Nov 08 16:23:17.357075 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a90b92ba-57bd-4715-bbef-d81a2b32a07c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8a4005b8-6559-44af-80ac-887042ce2d97,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:17.994907 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:21.323949 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 42984) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:21.423526 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9b3c0dbe-ec0d-43d9-acaf-b5c34f8f4a24 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:21.495546 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9b3c0dbe-ec0d-43d9-acaf-b5c34f8f4a24 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:21.499392 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9b3c0dbe-ec0d-43d9-acaf-b5c34f8f4a24 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:21.534302 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b3c0dbe-ec0d-43d9-acaf-b5c34f8f4a24 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4f49ce3e-4364-43bd-b37a-c7a7b16ab8f1,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:21.542091 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-9b3c0dbe-ec0d-43d9-acaf-b5c34f8f4a24 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=39f07a2d741e41eb82f7fb4b8df16dc7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2136190 Nov 08 16:23:21.542963 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 42988) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:21.591467 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7d2f5c34-80ba-49df-a6be-be48cfddd1eb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:21.612038 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7d2f5c34-80ba-49df-a6be-be48cfddd1eb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:21.655813 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7d2f5c34-80ba-49df-a6be-be48cfddd1eb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:21.658860 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7d2f5c34-80ba-49df-a6be-be48cfddd1eb admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:21.659983 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-7d2f5c34-80ba-49df-a6be-be48cfddd1eb admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/4f49ce3e-4364-43bd-b37a-c7a7b16ab8f1 HTTP/1.1" status: 204 len: 168 time: 0.1166708 Nov 08 16:23:21.667389 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d2f5c34-80ba-49df-a6be-be48cfddd1eb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4f49ce3e-4364-43bd-b37a-c7a7b16ab8f1,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:21.907776 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 42994) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:21.920896 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5f8d4362-100a-4de4-bc8e-0a6536ba96b6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:21.992868 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5f8d4362-100a-4de4-bc8e-0a6536ba96b6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:21.996532 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5f8d4362-100a-4de4-bc8e-0a6536ba96b6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:22.033342 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-5f8d4362-100a-4de4-bc8e-0a6536ba96b6 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=4e2d929cc1774dcb97d6bfdd972ecc96&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1245384 Nov 08 16:23:22.034313 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f8d4362-100a-4de4-bc8e-0a6536ba96b6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7c60d56a-255e-445f-9c60-862da6f92186,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:22.036093 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 42996) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:22.084231 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-2ff6597c-9f27-42ca-bea9-da2fe8a52d7b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:22.104284 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-2ff6597c-9f27-42ca-bea9-da2fe8a52d7b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:22.149869 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-2ff6597c-9f27-42ca-bea9-da2fe8a52d7b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:22.152303 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-2ff6597c-9f27-42ca-bea9-da2fe8a52d7b admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:22.153388 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-2ff6597c-9f27-42ca-bea9-da2fe8a52d7b admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/7c60d56a-255e-445f-9c60-862da6f92186 HTTP/1.1" status: 204 len: 168 time: 0.1155682 Nov 08 16:23:22.160527 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ff6597c-9f27-42ca-bea9-da2fe8a52d7b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7c60d56a-255e-445f-9c60-862da6f92186,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:25.612825 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43044) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:25.712889 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-edb3bb71-2f90-4868-8861-edbfd6f0c9ce admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:25.785512 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-edb3bb71-2f90-4868-8861-edbfd6f0c9ce admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:25.790416 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-edb3bb71-2f90-4868-8861-edbfd6f0c9ce admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:25.829166 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-edb3bb71-2f90-4868-8861-edbfd6f0c9ce admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=e8ab86ff3e4f429181da04167b18585b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2152739 Nov 08 16:23:25.830375 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edb3bb71-2f90-4868-8861-edbfd6f0c9ce admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7fda7328-88cf-4aa9-a79d-0bce77135105,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:25.831888 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 43048) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:25.882662 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-42260f70-37b2-4286-9a69-d9b33668337a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:25.902433 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-42260f70-37b2-4286-9a69-d9b33668337a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:25.946686 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-42260f70-37b2-4286-9a69-d9b33668337a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:25.949179 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-42260f70-37b2-4286-9a69-d9b33668337a admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:25.950320 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-42260f70-37b2-4286-9a69-d9b33668337a admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/7fda7328-88cf-4aa9-a79d-0bce77135105 HTTP/1.1" status: 204 len: 168 time: 0.1173637 Nov 08 16:23:25.960070 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42260f70-37b2-4286-9a69-d9b33668337a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7fda7328-88cf-4aa9-a79d-0bce77135105,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:33.457094 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44b15181-e13b-4df8-91d7-7716a100015f req-6897a713-3a48-4ec9-9778-6007fb1f29a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:23:33.458568 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-44b15181-e13b-4df8-91d7-7716a100015f req-6897a713-3a48-4ec9-9778-6007fb1f29a2 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 947 time: 0.0468645 Nov 08 16:23:33.504475 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-44b15181-e13b-4df8-91d7-7716a100015f req-833c74b6-0782-418f-b99f-84dfdff1e66e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400164 Nov 08 16:23:34.622989 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89694b25-404a-49c0-9952-43eaaf5da72c req-584cc8f3-8e67-4e64-a3d5-31580cd32cf7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:23:34.624407 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-89694b25-404a-49c0-9952-43eaaf5da72c req-584cc8f3-8e67-4e64-a3d5-31580cd32cf7 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 947 time: 0.0470061 Nov 08 16:23:34.673469 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-89694b25-404a-49c0-9952-43eaaf5da72c req-72d696d2-11c2-45fb-adfc-7c3a93d4ff22 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups?id=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426965 Nov 08 16:23:35.042183 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d25f18c-6ab8-41bd-b450-0021c36d3ec5 req-f01d3a42-ca1e-4e63-a157-d94e7c6bce9d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:23:35.043610 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5d25f18c-6ab8-41bd-b450-0021c36d3ec5 req-f01d3a42-ca1e-4e63-a157-d94e7c6bce9d tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.25 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 947 time: 0.0468066 Nov 08 16:23:35.131349 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-5d25f18c-6ab8-41bd-b450-0021c36d3ec5 req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Deleting port b3094cea-72ef-41cf-ac88-a6d678f0fb09 {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:23:35.131681 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-5d25f18c-6ab8-41bd-b450-0021c36d3ec5 req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:35.219769 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-5d25f18c-6ab8-41bd-b450-0021c36d3ec5 req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] For port b3094cea-72ef-41cf-ac88-a6d678f0fb09, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=b3094cea-72ef-41cf-ac88-a6d678f0fb09,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:23:35.220127 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-5d25f18c-6ab8-41bd-b450-0021c36d3ec5 req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:35.383213 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-5d25f18c-6ab8-41bd-b450-0021c36d3ec5 req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:35.383484 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-5d25f18c-6ab8-41bd-b450-0021c36d3ec5 req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-2032271'] for floatingip, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:35.383795 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.db.l3_db [req-5d25f18c-6ab8-41bd-b450-0021c36d3ec5 req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Floating IP 393a95ad-ba5e-4909-9857-e0f0e9617832 disassociated. External IP: 172.27.3.63, port: b3094cea-72ef-41cf-ac88-a6d678f0fb09. Nov 08 16:23:35.384128 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-5d25f18c-6ab8-41bd-b450-0021c36d3ec5 req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling delete_port for b3094cea-72ef-41cf-ac88-a6d678f0fb09 owned by compute:nova {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:23:35.508238 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-5d25f18c-6ab8-41bd-b450-0021c36d3ec5 req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:35.535690 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Pushing event deleted for resources: {'Port': ['ID=b3094cea-72ef-41cf-ac88-a6d678f0fb09,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:35.547228 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:35.548062 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:35.548392 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:35.548714 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:35.549042 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:35.549360 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:35.549683 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:35.550033 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:35.550348 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:35.550660 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:35.550980 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:35.551287 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:35.656208 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.l3_agent_scheduler [req-5d25f18c-6ab8-41bd-b450-0021c36d3ec5 req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Router e5087790-dc76-4f18-81a3-548feaf21791 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:23:35.730232 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43070) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:35.772298 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fc6e73b8-2e94-48d5-a250-6bf9378d92bd req-7bdb9ca5-29f5-4831-8c97-3954fdc8d019 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/ports?device_id=f0c4ded0-3419-458b-ab12-da310a2b2fd7 HTTP/1.1" status: 200 len: 210 time: 0.0273838 Nov 08 16:23:35.788813 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-5d25f18c-6ab8-41bd-b450-0021c36d3ec5 req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:23:35.801193 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e2afa7b-ee03-451b-8d11-0bfef3ad07fb None None] Sync routers for ids ['e5087790-dc76-4f18-81a3-548feaf21791'] in dv-cinder-816187-2-iscsi {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:23:35.822608 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e2afa7b-ee03-451b-8d11-0bfef3ad07fb None None] Routers {'e5087790-dc76-4f18-81a3-548feaf21791'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:23:35.823415 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-4e2afa7b-ee03-451b-8d11-0bfef3ad07fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:23:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['e5087790-dc76-4f18-81a3-548feaf21791'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:35.834572 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-5d25f18c-6ab8-41bd-b450-0021c36d3ec5 req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] No DVR routers for this DVR port b3094cea-72ef-41cf-ac88-a6d678f0fb09 on host hv-cinder-81618 {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:23:35.837387 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-5d25f18c-6ab8-41bd-b450-0021c36d3ec5 req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:35.840845 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5d25f18c-6ab8-41bd-b450-0021c36d3ec5 req-9b06757d-3616-4816-8ea6-364779378936 tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.25 "DELETE /v2.0/ports/b3094cea-72ef-41cf-ac88-a6d678f0fb09 HTTP/1.1" status: 204 len: 173 time: 0.7909789 Nov 08 16:23:35.841299 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f0c4ded0-3419-458b-ab12-da310a2b2fd7', 'name': 'network-vif-deleted', 'tag': 'b3094cea-72ef-41cf-ac88-a6d678f0fb09'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:23:35.844772 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ab70c81f-dc6f-45d6-8d9d-f281bc6fb195" -d '{"events": [{"server_uuid": "f0c4ded0-3419-458b-ab12-da310a2b2fd7", "name": "network-vif-deleted", "tag": "b3094cea-72ef-41cf-ac88-a6d678f0fb09"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:23:35.954755 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-4e2afa7b-ee03-451b-8d11-0bfef3ad07fb None None] Set router e5087790-dc76-4f18-81a3-548feaf21791 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:23:36.069781 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:23:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-408ec76e-407d-492d-8101-60732dd29acf x-openstack-request-id: req-408ec76e-407d-492d-8101-60732dd29acf {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:23:36.070510 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f0c4ded0-3419-458b-ab12-da310a2b2fd7", "name": "network-vif-deleted", "tag": "b3094cea-72ef-41cf-ac88-a6d678f0fb09", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:23:36.070927 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-408ec76e-407d-492d-8101-60732dd29acf {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:23:36.071476 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f0c4ded0-3419-458b-ab12-da310a2b2fd7', 'name': 'network-vif-deleted', 'tag': 'b3094cea-72ef-41cf-ac88-a6d678f0fb09', 'status': 'completed', 'code': 200} Nov 08 16:23:36.157867 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-d51bf9d5-20e6-4e94-a12d-46edebfe914e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Deleting port 11c207a7-6dfe-42ce-b33f-58a81860a38d {{(pid=101245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:23:36.158204 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d51bf9d5-20e6-4e94-a12d-46edebfe914e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:36.195439 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-4e2afa7b-ee03-451b-8d11-0bfef3ad07fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'name': 'tempest-AttachVolumeShelveTestJSON-1204269590-router', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118'}], 'enable_snat': True}, 'gw_port_id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:01Z', 'updated_at': '2021-11-08T16:11:11Z', 'revision_number': 4, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'gw_port': {'id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:db:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '9e08c20e-219c-4cd8-b6fe-30829b440d06', 'name': '', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'mac_address': 'fa:16:3e:e6:20:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:09Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 5, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'subnets': [{'id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:36.233062 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d51bf9d5-20e6-4e94-a12d-46edebfe914e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:36.233375 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d51bf9d5-20e6-4e94-a12d-46edebfe914e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:36.249420 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-d51bf9d5-20e6-4e94-a12d-46edebfe914e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling delete_port for 11c207a7-6dfe-42ce-b33f-58a81860a38d owned by network:floatingip {{(pid=101245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:23:36.314577 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e2afa7b-ee03-451b-8d11-0bfef3ad07fb None None] Checking router: e5087790-dc76-4f18-81a3-548feaf21791 for host: dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:23:36.323444 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e2afa7b-ee03-451b-8d11-0bfef3ad07fb None None] Routers {'e5087790-dc76-4f18-81a3-548feaf21791'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:23:36.324199 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-4e2afa7b-ee03-451b-8d11-0bfef3ad07fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:23:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['e5087790-dc76-4f18-81a3-548feaf21791'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:36.415208 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d51bf9d5-20e6-4e94-a12d-46edebfe914e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:36.435274 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-4e2afa7b-ee03-451b-8d11-0bfef3ad07fb None None] Set router e5087790-dc76-4f18-81a3-548feaf21791 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:23:36.439098 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d51bf9d5-20e6-4e94-a12d-46edebfe914e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Pushing event deleted for resources: {'Port': ['ID=11c207a7-6dfe-42ce-b33f-58a81860a38d,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:36.499680 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d51bf9d5-20e6-4e94-a12d-46edebfe914e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for floatingip, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:36.500006 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.db.l3_db [None req-d51bf9d5-20e6-4e94-a12d-46edebfe914e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Floating IP 5857c991-9f76-4345-8258-25f45eff26e8 disassociated (deleted). External IP: 172.27.3.239, port: ac61ca49-2eb1-4040-99b3-1fc5285b703f. Nov 08 16:23:36.628040 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-4e2afa7b-ee03-451b-8d11-0bfef3ad07fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'name': 'tempest-AttachVolumeShelveTestJSON-1204269590-router', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118'}], 'enable_snat': True}, 'gw_port_id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:01Z', 'updated_at': '2021-11-08T16:11:11Z', 'revision_number': 4, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'gw_port': {'id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:db:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '9e08c20e-219c-4cd8-b6fe-30829b440d06', 'name': '', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'mac_address': 'fa:16:3e:e6:20:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:09Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 5, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'subnets': [{'id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:36.658225 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e2afa7b-ee03-451b-8d11-0bfef3ad07fb None None] The sync data for ids ['e5087790-dc76-4f18-81a3-548feaf21791'] in dv-cinder-816187-2-iscsi is: [{'id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'name': 'tempest-AttachVolumeShelveTestJSON-1204269590-router', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118'}], 'enable_snat': True}, 'gw_port_id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:01Z', 'updated_at': '2021-11-08T16:11:11Z', 'revision_number': 4, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'gw_port': {'id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:db:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '9e08c20e-219c-4cd8-b6fe-30829b440d06', 'name': '', 'network_id': 'e0e08679-82fe-47eb-90b6-49a1713fdaca', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'mac_address': 'fa:16:3e:e6:20:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:09Z', 'updated_at': '2021-11-08T16:11:18Z', 'revision_number': 5, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'subnets': [{'id': 'fc52ff8b-1692-487b-a0de-f6290e65d880', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:23:36.701329 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d51bf9d5-20e6-4e94-a12d-46edebfe914e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Router f80d01f3-bee2-4682-8f4a-92536ad96209 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101245) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:23:36.810825 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d51bf9d5-20e6-4e94-a12d-46edebfe914e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101245) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:23:36.815631 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-d51bf9d5-20e6-4e94-a12d-46edebfe914e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for floatingip, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:36.823496 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42c46b1e-fef2-4062-ba0b-fede9cbe6c05 None None] Sync routers for ids ['f80d01f3-bee2-4682-8f4a-92536ad96209'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:23:36.838867 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-42c46b1e-fef2-4062-ba0b-fede9cbe6c05 None None] Routers {'f80d01f3-bee2-4682-8f4a-92536ad96209'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:23:36.839488 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-42c46b1e-fef2-4062-ba0b-fede9cbe6c05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:23:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['f80d01f3-bee2-4682-8f4a-92536ad96209'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:36.848838 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-d51bf9d5-20e6-4e94-a12d-46edebfe914e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "DELETE /v2.0/floatingips/5857c991-9f76-4345-8258-25f45eff26e8 HTTP/1.1" status: 204 len: 168 time: 1.1157331 Nov 08 16:23:36.848838 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f664b3dd-4458-4525-926a-1321ff188fdc', 'tag': 'ac61ca49-2eb1-4040-99b3-1fc5285b703f'}] {{(pid=101245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:23:36.850446 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9303bddee447de525cefc409d3d14f9dbe8ef1f21bfe9eb24fdef2609d4aa3c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e123185d-dc04-4267-bc62-d1b45da25832" -d '{"events": [{"name": "network-changed", "server_uuid": "f664b3dd-4458-4525-926a-1321ff188fdc", "tag": "ac61ca49-2eb1-4040-99b3-1fc5285b703f"}]}' {{(pid=101245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:23:36.885496 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43086) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:36.936766 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:23:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2e6669ef-e96b-4c95-aca2-f761f83b5c83 x-openstack-request-id: req-2e6669ef-e96b-4c95-aca2-f761f83b5c83 {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:23:36.937082 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f664b3dd-4458-4525-926a-1321ff188fdc", "tag": "ac61ca49-2eb1-4040-99b3-1fc5285b703f", "status": "completed", "code": 200}]} {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:23:36.937270 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-2e6669ef-e96b-4c95-aca2-f761f83b5c83 {{(pid=101245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:23:36.937670 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f664b3dd-4458-4525-926a-1321ff188fdc', 'tag': 'ac61ca49-2eb1-4040-99b3-1fc5285b703f', 'status': 'completed', 'code': 200} Nov 08 16:23:36.958902 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-16ad1684-1f63-4ab1-a583-fd10ae019bcd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:36.963268 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e3cf654-a02c-4293-81fd-9128ed1dc12d None None] New status for floating IP 393a95ad-ba5e-4909-9857-e0f0e9617832: DOWN {{(pid=101247) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 16:23:36.973442 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-42c46b1e-fef2-4062-ba0b-fede9cbe6c05 None None] Set router f80d01f3-bee2-4682-8f4a-92536ad96209 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:23:37.010207 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-16ad1684-1f63-4ab1-a583-fd10ae019bcd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:37.066802 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-16ad1684-1f63-4ab1-a583-fd10ae019bcd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:37.069537 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e123185d-dc04-4267-bc62-d1b45da25832 req-863121aa-2334-4c11-aa51-a2645b8e0455 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:23:37.070657 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-16ad1684-1f63-4ab1-a583-fd10ae019bcd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:37.071270 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e123185d-dc04-4267-bc62-d1b45da25832 req-863121aa-2334-4c11-aa51-a2645b8e0455 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=343d5ca096394f87bea0950aa3811a13&device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 1098 time: 0.1094906 Nov 08 16:23:37.074359 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-16ad1684-1f63-4ab1-a583-fd10ae019bcd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "DELETE /v2.0/security-groups/f26a5a81-43d9-4fa8-90aa-bc881ef38d5c HTTP/1.1" status: 204 len: 168 time: 0.1853390 Nov 08 16:23:37.075732 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43090) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:37.098614 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.api.v2.resource [None req-7703eaaa-0b3c-4f8f-90e9-4cf15765f76e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] show failed (client error): The resource could not be found. Nov 08 16:23:37.099660 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-7703eaaa-0b3c-4f8f-90e9-4cf15765f76e tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "GET /v2.0/security-groups/f26a5a81-43d9-4fa8-90aa-bc881ef38d5c HTTP/1.1" status: 404 len: 347 time: 0.0229945 Nov 08 16:23:37.103963 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43092) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:37.119497 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16ad1684-1f63-4ab1-a583-fd10ae019bcd tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f26a5a81-43d9-4fa8-90aa-bc881ef38d5c,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:37.250611 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-7ee8072e-fceb-4581-8570-055996b1ddff tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Deleting port 8eb1e1e9-fa10-456e-aefb-54510a78d6d6 {{(pid=101245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:23:37.250963 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7ee8072e-fceb-4581-8570-055996b1ddff tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:37.336401 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7ee8072e-fceb-4581-8570-055996b1ddff tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:37.336774 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7ee8072e-fceb-4581-8570-055996b1ddff tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:37.349328 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-7ee8072e-fceb-4581-8570-055996b1ddff tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Calling delete_port for 8eb1e1e9-fa10-456e-aefb-54510a78d6d6 owned by network:floatingip {{(pid=101245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:23:37.417835 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-42c46b1e-fef2-4062-ba0b-fede9cbe6c05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 4, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': 'f569e85e-1fe4-4f0e-9589-b8abeab39e2b', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'floating_ip_address': '172.27.3.223', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'port_id': '794847db-0663-47ab-a2b0-4bdedb698598', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 536, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'mac_address': 'fa:16:3e:43:4e:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ce49cb3-8d64-40a5-9827-64fa1d2f37c2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:18:40Z', 'updated_at': '2021-11-08T16:18:41Z', 'revision_number': 1, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbdf39d9-310f-42ea-a1f1-4e1b15048b73', 'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'mac_address': 'fa:16:3e:13:ec:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_interface', 'standard_attr_id': 228, 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:28Z', 'updated_at': '2021-11-08T16:12:32Z', 'revision_number': 5, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'subnets': [{'id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:37.448206 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42c46b1e-fef2-4062-ba0b-fede9cbe6c05 None None] Checking router: f80d01f3-bee2-4682-8f4a-92536ad96209 for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:23:37.455033 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0a42796-2037-4d08-a476-b82ef5d74ef2 req-ae85fa7c-ee00-4f2c-aaa6-d0a20f7ad9b0 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:23:37.456524 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e0a42796-2037-4d08-a476-b82ef5d74ef2 req-ae85fa7c-ee00-4f2c-aaa6-d0a20f7ad9b0 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 945 time: 0.3409853 Nov 08 16:23:37.463433 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-42c46b1e-fef2-4062-ba0b-fede9cbe6c05 None None] Routers {'f80d01f3-bee2-4682-8f4a-92536ad96209'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:23:37.464075 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-42c46b1e-fef2-4062-ba0b-fede9cbe6c05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:23:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['f80d01f3-bee2-4682-8f4a-92536ad96209'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:37.484979 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e123185d-dc04-4267-bc62-d1b45da25832 req-12eb9e1f-4b22-4170-bd3f-3ea0ea4210e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:23:37.487381 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e123185d-dc04-4267-bc62-d1b45da25832 req-12eb9e1f-4b22-4170-bd3f-3ea0ea4210e0 service neutron] 10.222.0.25 "GET /v2.0/networks?id=a15e051b-c130-4140-aaf2-a45ea7af5b43 HTTP/1.1" status: 200 len: 913 time: 0.4073129 Nov 08 16:23:37.490660 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7ee8072e-fceb-4581-8570-055996b1ddff tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:37.522332 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ee8072e-fceb-4581-8570-055996b1ddff tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Pushing event deleted for resources: {'Port': ['ID=8eb1e1e9-fa10-456e-aefb-54510a78d6d6,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:37.541913 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e123185d-dc04-4267-bc62-d1b45da25832 req-774564c7-d4ea-4cc0-9b11-f3a5013c5300 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=ac61ca49-2eb1-4040-99b3-1fc5285b703f HTTP/1.1" status: 200 len: 217 time: 0.0429571 Nov 08 16:23:37.550603 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e0a42796-2037-4d08-a476-b82ef5d74ef2 req-f374f516-aaf9-4220-acee-35193100888b tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0877039 Nov 08 16:23:37.574482 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-42c46b1e-fef2-4062-ba0b-fede9cbe6c05 None None] Set router f80d01f3-bee2-4682-8f4a-92536ad96209 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:23:37.584958 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7ee8072e-fceb-4581-8570-055996b1ddff tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks [] for floatingip, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:37.587581 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7ee8072e-fceb-4581-8570-055996b1ddff tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for floatingip, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:37.592686 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-7ee8072e-fceb-4581-8570-055996b1ddff tempest-AttachVolumeShelveTestJSON-560700696 tempest-AttachVolumeShelveTestJSON-560700696-project] 10.222.0.37 "DELETE /v2.0/floatingips/393a95ad-ba5e-4909-9857-e0f0e9617832 HTTP/1.1" status: 204 len: 168 time: 0.4838545 Nov 08 16:23:37.617321 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e123185d-dc04-4267-bc62-d1b45da25832 req-6ed0538c-55d1-4689-b15d-d0ce11e12dec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:23:37.619301 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e123185d-dc04-4267-bc62-d1b45da25832 req-6ed0538c-55d1-4689-b15d-d0ce11e12dec service neutron] 10.222.0.25 "GET /v2.0/subnets?id=6e4d65b1-4f2c-453a-847c-970dff985732 HTTP/1.1" status: 200 len: 851 time: 0.0678709 Nov 08 16:23:37.667873 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e123185d-dc04-4267-bc62-d1b45da25832 req-bbab5a7d-5be2-4539-8cb4-d83e965bc49b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:23:37.669406 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e123185d-dc04-4267-bc62-d1b45da25832 req-bbab5a7d-5be2-4539-8cb4-d83e965bc49b service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=a15e051b-c130-4140-aaf2-a45ea7af5b43&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0418639 Nov 08 16:23:37.768139 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e123185d-dc04-4267-bc62-d1b45da25832 req-dc5ff787-dce5-4ff1-92ee-9b2335dba74f service neutron] 10.222.0.25 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0890658 Nov 08 16:23:37.812612 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-42c46b1e-fef2-4062-ba0b-fede9cbe6c05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 4, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': 'f569e85e-1fe4-4f0e-9589-b8abeab39e2b', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'floating_ip_address': '172.27.3.223', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'port_id': '794847db-0663-47ab-a2b0-4bdedb698598', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 536, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'mac_address': 'fa:16:3e:43:4e:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ce49cb3-8d64-40a5-9827-64fa1d2f37c2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:18:40Z', 'updated_at': '2021-11-08T16:18:41Z', 'revision_number': 1, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbdf39d9-310f-42ea-a1f1-4e1b15048b73', 'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'mac_address': 'fa:16:3e:13:ec:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_interface', 'standard_attr_id': 228, 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:28Z', 'updated_at': '2021-11-08T16:12:32Z', 'revision_number': 5, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'subnets': [{'id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:37.842423 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42c46b1e-fef2-4062-ba0b-fede9cbe6c05 None None] The sync data for ids ['f80d01f3-bee2-4682-8f4a-92536ad96209'] in dv-cinder-816187-2-iscsi is: [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 4, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_floatingips': [{'id': 'f569e85e-1fe4-4f0e-9589-b8abeab39e2b', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'floating_ip_address': '172.27.3.223', 'floating_network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'router_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'port_id': '794847db-0663-47ab-a2b0-4bdedb698598', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 536, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'mac_address': 'fa:16:3e:43:4e:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ce49cb3-8d64-40a5-9827-64fa1d2f37c2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T16:18:40Z', 'updated_at': '2021-11-08T16:18:41Z', 'revision_number': 1, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbdf39d9-310f-42ea-a1f1-4e1b15048b73', 'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'mac_address': 'fa:16:3e:13:ec:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_interface', 'standard_attr_id': 228, 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:28Z', 'updated_at': '2021-11-08T16:12:32Z', 'revision_number': 5, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'subnets': [{'id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:23:37.861068 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e123185d-dc04-4267-bc62-d1b45da25832 req-900a0945-6a7f-4502-a534-1ce725202e6e service neutron] 10.222.0.25 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847282 Nov 08 16:23:38.064030 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-78772a95-fe51-47c7-97e6-2e96190b5bd6 None None] New status for floating IP 5857c991-9f76-4345-8258-25f45eff26e8: DOWN {{(pid=101246) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 16:23:38.137355 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-dd2c7011-9f5c-44d3-8bab-cdd6a314f286 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:38.596550 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:23:38.674278 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62a91461-64ba-4155-843c-1e300ded40e8 req-956c0240-8a86-4b8e-9238-d26698cd9989 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:23:38.675742 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-62a91461-64ba-4155-843c-1e300ded40e8 req-956c0240-8a86-4b8e-9238-d26698cd9989 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 945 time: 0.0483308 Nov 08 16:23:38.723047 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-62a91461-64ba-4155-843c-1e300ded40e8 req-eb1ed0a9-a3d9-4c5c-a1c5-6365da177db4 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414472 Nov 08 16:23:38.874099 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a483f901-a9b6-43ce-894f-3bea2a02de0d req-7982a04d-b89b-4de0-865f-54a1b24fe67a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:23:38.876056 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a483f901-a9b6-43ce-894f-3bea2a02de0d req-7982a04d-b89b-4de0-865f-54a1b24fe67a tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.25 "GET /v2.0/ports?device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 945 time: 0.0518866 Nov 08 16:23:38.970766 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-a483f901-a9b6-43ce-894f-3bea2a02de0d req-f8b547b1-13c8-4943-825a-cee6ad7f9153 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Deleting port ac61ca49-2eb1-4040-99b3-1fc5285b703f {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:23:38.971098 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-a483f901-a9b6-43ce-894f-3bea2a02de0d req-f8b547b1-13c8-4943-825a-cee6ad7f9153 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:39.057360 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-a483f901-a9b6-43ce-894f-3bea2a02de0d req-f8b547b1-13c8-4943-825a-cee6ad7f9153 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] For port ac61ca49-2eb1-4040-99b3-1fc5285b703f, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=ac61ca49-2eb1-4040-99b3-1fc5285b703f,segment=NetworkSegment(1383b9f8-d178-4a90-828c-184fa1886253),segment_id=1383b9f8-d178-4a90-828c-184fa1886253)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:23:39.057735 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-a483f901-a9b6-43ce-894f-3bea2a02de0d req-f8b547b1-13c8-4943-825a-cee6ad7f9153 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:39.070848 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-a483f901-a9b6-43ce-894f-3bea2a02de0d req-f8b547b1-13c8-4943-825a-cee6ad7f9153 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling delete_port for ac61ca49-2eb1-4040-99b3-1fc5285b703f owned by compute:nova {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:23:39.193556 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-a483f901-a9b6-43ce-894f-3bea2a02de0d req-f8b547b1-13c8-4943-825a-cee6ad7f9153 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:39.226208 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8b547b1-13c8-4943-825a-cee6ad7f9153 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Pushing event deleted for resources: {'Port': ['ID=ac61ca49-2eb1-4040-99b3-1fc5285b703f,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:39.268721 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-a483f901-a9b6-43ce-894f-3bea2a02de0d req-f8b547b1-13c8-4943-825a-cee6ad7f9153 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] No DVR routers for this DVR port ac61ca49-2eb1-4040-99b3-1fc5285b703f on host hv-cinder-81618 {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:23:39.271413 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-a483f901-a9b6-43ce-894f-3bea2a02de0d req-f8b547b1-13c8-4943-825a-cee6ad7f9153 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:39.274751 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a483f901-a9b6-43ce-894f-3bea2a02de0d req-f8b547b1-13c8-4943-825a-cee6ad7f9153 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.25 "DELETE /v2.0/ports/ac61ca49-2eb1-4040-99b3-1fc5285b703f HTTP/1.1" status: 204 len: 173 time: 0.3898885 Nov 08 16:23:39.275172 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f664b3dd-4458-4525-926a-1321ff188fdc', 'name': 'network-vif-deleted', 'tag': 'ac61ca49-2eb1-4040-99b3-1fc5285b703f'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:23:39.277491 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4edf54a8-d03c-4807-8d46-d157316ae347" -d '{"events": [{"server_uuid": "f664b3dd-4458-4525-926a-1321ff188fdc", "name": "network-vif-deleted", "tag": "ac61ca49-2eb1-4040-99b3-1fc5285b703f"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:23:39.320179 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:23:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-96fcfcd5-84b6-43b8-a13c-75f86408990c x-openstack-request-id: req-96fcfcd5-84b6-43b8-a13c-75f86408990c {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:23:39.320769 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f664b3dd-4458-4525-926a-1321ff188fdc", "name": "network-vif-deleted", "tag": "ac61ca49-2eb1-4040-99b3-1fc5285b703f", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:23:39.321097 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-96fcfcd5-84b6-43b8-a13c-75f86408990c {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:23:39.321930 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f664b3dd-4458-4525-926a-1321ff188fdc', 'name': 'network-vif-deleted', 'tag': 'ac61ca49-2eb1-4040-99b3-1fc5285b703f', 'status': 'completed', 'code': 200} Nov 08 16:23:39.472973 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device b3094cea-72ef-41cf-ac88-a6d678f0fb09 no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:23:39.496074 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] No Port match for: b3094cea-72ef-41cf-ac88-a6d678f0fb09 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:23:39.496414 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device b3094cea-72ef-41cf-ac88-a6d678f0fb09 not bound to the agent host hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:23:39.825556 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-1bf13e0f-b0ee-4245-a945-ccc6d918491c req-316db39d-cef6-43f0-b73c-6f30309cb18f tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=f664b3dd-4458-4525-926a-1321ff188fdc HTTP/1.1" status: 200 len: 210 time: 0.0250530 Nov 08 16:23:40.037076 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43122) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:40.469042 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9a36619e-16ac-4e8a-a7a8-d6de56d6026c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-2033295'] for router_interface, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:40.604614 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-8b6963f8-7953-4b74-9e4a-6b6bb0ba4bfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:40.700615 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-9a36619e-16ac-4e8a-a7a8-d6de56d6026c admin admin] Deleting port 9e08c20e-219c-4cd8-b6fe-30829b440d06 {{(pid=101245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:23:40.700941 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9a36619e-16ac-4e8a-a7a8-d6de56d6026c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:40.775940 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [None req-9a36619e-16ac-4e8a-a7a8-d6de56d6026c admin admin] For port 9e08c20e-219c-4cd8-b6fe-30829b440d06, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=9e08c20e-219c-4cd8-b6fe-30829b440d06,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:23:40.776314 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9a36619e-16ac-4e8a-a7a8-d6de56d6026c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:40.788780 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-9a36619e-16ac-4e8a-a7a8-d6de56d6026c admin admin] Calling delete_port for 9e08c20e-219c-4cd8-b6fe-30829b440d06 owned by network:router_interface {{(pid=101245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:23:40.965647 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9a36619e-16ac-4e8a-a7a8-d6de56d6026c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:40.994646 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a36619e-16ac-4e8a-a7a8-d6de56d6026c admin admin] Pushing event deleted for resources: {'Port': ['ID=9e08c20e-219c-4cd8-b6fe-30829b440d06,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:41.158312 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-9a36619e-16ac-4e8a-a7a8-d6de56d6026c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1599532', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-2034495'] for router_interface, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:41.363687 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9a36619e-16ac-4e8a-a7a8-d6de56d6026c admin admin] Router e5087790-dc76-4f18-81a3-548feaf21791 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101245) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:23:41.568972 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:41.709482 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9a36619e-16ac-4e8a-a7a8-d6de56d6026c admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101245) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:23:41.714411 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-9a36619e-16ac-4e8a-a7a8-d6de56d6026c admin admin] 10.222.0.37 "PUT /v2.0/routers/e5087790-dc76-4f18-81a3-548feaf21791/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6762664 Nov 08 16:23:41.716922 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43132) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:41.719849 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8177cd7-63d1-48cb-a981-ea5a06438aa2 None None] Sync routers for ids ['e5087790-dc76-4f18-81a3-548feaf21791'] in dv-cinder-816187-2-iscsi {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:23:41.729797 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8177cd7-63d1-48cb-a981-ea5a06438aa2 None None] Routers {'e5087790-dc76-4f18-81a3-548feaf21791'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:23:41.730340 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-f8177cd7-63d1-48cb-a981-ea5a06438aa2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:23:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['e5087790-dc76-4f18-81a3-548feaf21791'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:41.821155 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Publish callbacks [] for router, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:41.836132 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-f8177cd7-63d1-48cb-a981-ea5a06438aa2 None None] Set router e5087790-dc76-4f18-81a3-548feaf21791 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:23:41.920883 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:41.975784 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Deleting port d3af559a-99c6-40a2-85f2-bab38b3887e1 {{(pid=101245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:23:41.976009 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:42.022904 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-f8177cd7-63d1-48cb-a981-ea5a06438aa2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'name': 'tempest-AttachVolumeShelveTestJSON-1204269590-router', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118'}], 'enable_snat': True}, 'gw_port_id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:01Z', 'updated_at': '2021-11-08T16:23:40Z', 'revision_number': 5, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'gw_port': {'id': 'd3af559a-99c6-40a2-85f2-bab38b3887e1', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:db:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:11:03Z', 'updated_at': '2021-11-08T16:11:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:42.054957 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8177cd7-63d1-48cb-a981-ea5a06438aa2 None None] Checking router: e5087790-dc76-4f18-81a3-548feaf21791 for host: dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:23:42.058689 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] For port d3af559a-99c6-40a2-85f2-bab38b3887e1, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=d3af559a-99c6-40a2-85f2-bab38b3887e1,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:23:42.059033 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:42.065403 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8177cd7-63d1-48cb-a981-ea5a06438aa2 None None] Routers {'e5087790-dc76-4f18-81a3-548feaf21791'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:23:42.066128 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-f8177cd7-63d1-48cb-a981-ea5a06438aa2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:23:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['e5087790-dc76-4f18-81a3-548feaf21791'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:42.073283 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Calling delete_port for d3af559a-99c6-40a2-85f2-bab38b3887e1 owned by network:router_gateway {{(pid=101245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:23:42.151119 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-f8177cd7-63d1-48cb-a981-ea5a06438aa2 None None] Set router e5087790-dc76-4f18-81a3-548feaf21791 gateway port host: None {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:23:42.200942 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-f8177cd7-63d1-48cb-a981-ea5a06438aa2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'name': 'tempest-AttachVolumeShelveTestJSON-1204269590-router', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:01Z', 'updated_at': '2021-11-08T16:23:41Z', 'revision_number': 6, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'gw_port_host': None}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:42.229578 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8177cd7-63d1-48cb-a981-ea5a06438aa2 None None] The sync data for ids ['e5087790-dc76-4f18-81a3-548feaf21791'] in dv-cinder-816187-2-iscsi is: [{'id': 'e5087790-dc76-4f18-81a3-548feaf21791', 'name': 'tempest-AttachVolumeShelveTestJSON-1204269590-router', 'tenant_id': '10a4252a63bf480d93d2e9da15bb8efd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:11:01Z', 'updated_at': '2021-11-08T16:23:41Z', 'revision_number': 6, 'project_id': '10a4252a63bf480d93d2e9da15bb8efd', 'gw_port_host': None}] {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:23:42.234614 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:42.260800 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Pushing event deleted for resources: {'Port': ['ID=d3af559a-99c6-40a2-85f2-bab38b3887e1,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:42.272369 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:42.272715 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:42.273052 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:42.273389 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:42.273746 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:42.274069 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:42.274395 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:42.274717 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:42.275037 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:42.275357 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:42.275677 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:42.275990 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:42.332394 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-2032325'] for router_gateway, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:42.428858 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-2034023', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-12866'] for router, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:42.430968 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:42.473406 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-2034044'] for router, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:42.473951 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Fanout notify agent at l3_agent the message router_deleted on router e5087790-dc76-4f18-81a3-548feaf21791 {{(pid=101245) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 08 16:23:42.478225 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] Publish callbacks [] for router, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:42.479556 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-fd33ab3e-6221-45a3-b13f-8887702031cc admin admin] 10.222.0.37 "DELETE /v2.0/routers/e5087790-dc76-4f18-81a3-548feaf21791 HTTP/1.1" status: 204 len: 168 time: 0.7617266 Nov 08 16:23:42.482024 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43140) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:42.527668 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_v2 [None req-e68c48ab-2046-4289-a766-77b911979164 admin admin] Deleting subnet fc52ff8b-1692-487b-a0de-f6290e65d880 {{(pid=101245) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 16:23:42.530582 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e68c48ab-2046-4289-a766-77b911979164 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:42.564184 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e68c48ab-2046-4289-a766-77b911979164 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5113603'] for subnet, precommit_delete_associations {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:42.643180 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e68c48ab-2046-4289-a766-77b911979164 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-872226'] for subnet, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:42.694217 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e68c48ab-2046-4289-a766-77b911979164 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-872235', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7464090', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6098572'] for subnet, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:42.723716 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e68c48ab-2046-4289-a766-77b911979164 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fc52ff8b-1692-487b-a0de-f6290e65d880,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:42.725739 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e68c48ab-2046-4289-a766-77b911979164 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:42.729364 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d48872a7-fb5b-49ef-8d53-3b37875f32af None None] Network e0e08679-82fe-47eb-90b6-49a1713fdaca requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:23:42.729879 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-e68c48ab-2046-4289-a766-77b911979164 admin admin] 10.222.0.37 "DELETE /v2.0/subnets/fc52ff8b-1692-487b-a0de-f6290e65d880 HTTP/1.1" status: 204 len: 168 time: 0.2466083 Nov 08 16:23:42.731529 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 43142) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:42.802110 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f122604f-2d43-41b5-abd2-1a2c4c49eae1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1007047'] for network, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:42.852479 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-f122604f-2d43-41b5-abd2-1a2c4c49eae1 admin admin] Deleting port 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7 {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:23:42.852815 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f122604f-2d43-41b5-abd2-1a2c4c49eae1 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:42.914758 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [None req-f122604f-2d43-41b5-abd2-1a2c4c49eae1 admin admin] For port 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7,segment=NetworkSegment(13aab495-f4c4-414c-b50c-fd22b4e0ef0b),segment_id=13aab495-f4c4-414c-b50c-fd22b4e0ef0b)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:23:42.915375 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f122604f-2d43-41b5-abd2-1a2c4c49eae1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:42.928286 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-f122604f-2d43-41b5-abd2-1a2c4c49eae1 admin admin] Calling delete_port for 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7 owned by network:dhcp {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:23:42.982394 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-23b263ef-eeca-40b6-9f33-fbacda19e2d8 None None] DHCP port deletion for e0e08679-82fe-47eb-90b6-49a1713fdaca request from dv-cinder-816187-2-iscsi {{(pid=101246) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 08 16:23:43.010567 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f122604f-2d43-41b5-abd2-1a2c4c49eae1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:43.030468 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-23b263ef-eeca-40b6-9f33-fbacda19e2d8 None None] Deleting port 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7 {{(pid=101246) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:23:43.030833 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-23b263ef-eeca-40b6-9f33-fbacda19e2d8 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:43.038013 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f122604f-2d43-41b5-abd2-1a2c4c49eae1 admin admin] Pushing event deleted for resources: {'Port': ['ID=2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:43.039824 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f122604f-2d43-41b5-abd2-1a2c4c49eae1 admin admin] No DVR routers for this DVR port 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7 on host dv-cinder-816187-2-iscsi {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:23:43.104636 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-23b263ef-eeca-40b6-9f33-fbacda19e2d8 None None] For port 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7, host dv-cinder-816187-2-iscsi, got binding levels [] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:23:43.105030 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-23b263ef-eeca-40b6-9f33-fbacda19e2d8 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:43.107862 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 43146) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:43.121176 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-23b263ef-eeca-40b6-9f33-fbacda19e2d8 None None] Calling delete_port for 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7 owned by network:dhcp {{(pid=101246) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:23:43.124244 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.ipam_backend_mixin [None req-23b263ef-eeca-40b6-9f33-fbacda19e2d8 None None] Port 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7 was not found and therefore no delete operation was performed {{(pid=101246) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 08 16:23:43.125470 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-23b263ef-eeca-40b6-9f33-fbacda19e2d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364'] for port, after_delete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:43.150781 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23b263ef-eeca-40b6-9f33-fbacda19e2d8 None None] Pushing event deleted for resources: {'Port': ['ID=2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7,revision_number=None']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:43.155036 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-23b263ef-eeca-40b6-9f33-fbacda19e2d8 None None] No DVR routers for this DVR port 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7 on host dv-cinder-816187-2-iscsi {{(pid=101246) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:23:43.160844 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f122604f-2d43-41b5-abd2-1a2c4c49eae1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-869719', 'neutron.services.segments.db._delete_segments_for_network-8792877333297'] for network, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:43.162269 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23b263ef-eeca-40b6-9f33-fbacda19e2d8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:43.162805 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23b263ef-eeca-40b6-9f33-fbacda19e2d8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:43.163312 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23b263ef-eeca-40b6-9f33-fbacda19e2d8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:43.163812 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23b263ef-eeca-40b6-9f33-fbacda19e2d8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:43.164618 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23b263ef-eeca-40b6-9f33-fbacda19e2d8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:43.164618 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23b263ef-eeca-40b6-9f33-fbacda19e2d8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:43.164810 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23b263ef-eeca-40b6-9f33-fbacda19e2d8 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:43.166132 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23b263ef-eeca-40b6-9f33-fbacda19e2d8 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:43.166474 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23b263ef-eeca-40b6-9f33-fbacda19e2d8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:43.166801 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23b263ef-eeca-40b6-9f33-fbacda19e2d8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:43.167124 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23b263ef-eeca-40b6-9f33-fbacda19e2d8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:43.167443 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23b263ef-eeca-40b6-9f33-fbacda19e2d8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:23:43.189278 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-f122604f-2d43-41b5-abd2-1a2c4c49eae1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e0e08679-82fe-47eb-90b6-49a1713fdaca']}} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:43.204624 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-f122604f-2d43-41b5-abd2-1a2c4c49eae1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '13aab495-f4c4-414c-b50c-fd22b4e0ef0b') {'for_net_delete': True} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:43.204876 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-f122604f-2d43-41b5-abd2-1a2c4c49eae1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '13aab495-f4c4-414c-b50c-fd22b4e0ef0b') {} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:43.245027 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f122604f-2d43-41b5-abd2-1a2c4c49eae1 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792877333818', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8047118'] for segment, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:43.270400 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f122604f-2d43-41b5-abd2-1a2c4c49eae1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:43.281698 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f122604f-2d43-41b5-abd2-1a2c4c49eae1 admin admin] Releasing vlan 188 on physical network physnet1 to pool {{(pid=101244) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 16:23:43.282122 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f122604f-2d43-41b5-abd2-1a2c4c49eae1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4227628'] for segment, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: Traceback (most recent call last): Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: timer() Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: cb(*args, **kw) Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: return func(*args, **kwargs) Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: self._notify() Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: self.callback(batched_events) Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: event.method(event) Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: return f(self, *a, **k) Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: return self._get(url).json() Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: return self.request(url, 'GET', **kwargs) Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 16:23:43.283890 dv-cinder-816187-2-iscsi neutron-server[101244]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 16:23:43.304321 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:43.355860 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f122604f-2d43-41b5-abd2-1a2c4c49eae1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-868772', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-2032313'] for network, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:43.362564 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f122604f-2d43-41b5-abd2-1a2c4c49eae1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:43.365692 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-f122604f-2d43-41b5-abd2-1a2c4c49eae1 admin admin] 10.222.0.37 "DELETE /v2.0/networks/e0e08679-82fe-47eb-90b6-49a1713fdaca HTTP/1.1" status: 204 len: 168 time: 0.6326325 Nov 08 16:23:43.381224 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f122604f-2d43-41b5-abd2-1a2c4c49eae1 admin admin] Pushing event deleted for resources: {'Network': ['ID=e0e08679-82fe-47eb-90b6-49a1713fdaca,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:43.388206 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-8614cd72-5fc1-4933-beef-f353681056ad tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Deleting port 1f77e135-23e3-4d19-a577-01f3b4e8bc2a {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:23:43.388611 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8614cd72-5fc1-4933-beef-f353681056ad tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:43.467491 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8614cd72-5fc1-4933-beef-f353681056ad tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:43.467820 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8614cd72-5fc1-4933-beef-f353681056ad tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:43.478187 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43150) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:43.479679 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-8614cd72-5fc1-4933-beef-f353681056ad tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling delete_port for 1f77e135-23e3-4d19-a577-01f3b4e8bc2a owned by network:floatingip {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:23:43.491997 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device ac61ca49-2eb1-4040-99b3-1fc5285b703f no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:23:43.514033 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] No Port match for: ac61ca49-2eb1-4040-99b3-1fc5285b703f {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:23:43.514719 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device ac61ca49-2eb1-4040-99b3-1fc5285b703f not bound to the agent host hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:23:43.520210 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-707d5333-cf98-4fb2-a342-483712e5b5a8 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=10a4252a63bf480d93d2e9da15bb8efd&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0408909 Nov 08 16:23:43.522788 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43152) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:43.568150 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-756ad0a5-868f-487b-886b-e243c1bdacfd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:43.588254 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-756ad0a5-868f-487b-886b-e243c1bdacfd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:43.635483 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-756ad0a5-868f-487b-886b-e243c1bdacfd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:43.638136 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-756ad0a5-868f-487b-886b-e243c1bdacfd admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:43.639372 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-756ad0a5-868f-487b-886b-e243c1bdacfd admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/7bd95f0a-8c65-4087-8c2d-b857133d9bf4 HTTP/1.1" status: 204 len: 168 time: 0.1157024 Nov 08 16:23:43.649130 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-756ad0a5-868f-487b-886b-e243c1bdacfd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7bd95f0a-8c65-4087-8c2d-b857133d9bf4,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:43.653438 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8614cd72-5fc1-4933-beef-f353681056ad tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:43.680590 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8614cd72-5fc1-4933-beef-f353681056ad tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Pushing event deleted for resources: {'Port': ['ID=1f77e135-23e3-4d19-a577-01f3b4e8bc2a,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:43.752404 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8614cd72-5fc1-4933-beef-f353681056ad tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for floatingip, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:43.753065 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.db.l3_db [None req-8614cd72-5fc1-4933-beef-f353681056ad tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Floating IP f569e85e-1fe4-4f0e-9589-b8abeab39e2b disassociated (deleted). External IP: 172.27.3.223, port: 794847db-0663-47ab-a2b0-4bdedb698598. Nov 08 16:23:43.886969 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device d3af559a-99c6-40a2-85f2-bab38b3887e1 no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:23:43.908335 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: d3af559a-99c6-40a2-85f2-bab38b3887e1 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:23:43.908685 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device d3af559a-99c6-40a2-85f2-bab38b3887e1 not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:23:43.909182 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7 no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:23:43.937978 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:23:43.938322 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 2c7e4be3-35cd-4d5a-aaa2-fcd9617944a7 not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:23:43.938943 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 9e08c20e-219c-4cd8-b6fe-30829b440d06 no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:23:43.963468 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: 9e08c20e-219c-4cd8-b6fe-30829b440d06 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:23:43.964081 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 9e08c20e-219c-4cd8-b6fe-30829b440d06 not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:23:43.970055 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8614cd72-5fc1-4933-beef-f353681056ad tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Router f80d01f3-bee2-4682-8f4a-92536ad96209 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:23:43.979008 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:44.078125 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8614cd72-5fc1-4933-beef-f353681056ad tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:23:44.083833 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-8614cd72-5fc1-4933-beef-f353681056ad tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for floatingip, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:44.090137 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae32028b-6222-4ae7-a2b2-00187a237f26 None None] Sync routers for ids ['f80d01f3-bee2-4682-8f4a-92536ad96209'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:23:44.101377 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae32028b-6222-4ae7-a2b2-00187a237f26 None None] Routers {'f80d01f3-bee2-4682-8f4a-92536ad96209'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:23:44.102315 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-ae32028b-6222-4ae7-a2b2-00187a237f26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:23:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['f80d01f3-bee2-4682-8f4a-92536ad96209'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:44.117327 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-8614cd72-5fc1-4933-beef-f353681056ad tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "DELETE /v2.0/floatingips/f569e85e-1fe4-4f0e-9589-b8abeab39e2b HTTP/1.1" status: 204 len: 168 time: 1.0076859 Nov 08 16:23:44.117937 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5ce49cb3-8d64-40a5-9827-64fa1d2f37c2', 'tag': '794847db-0663-47ab-a2b0-4bdedb698598'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:23:44.120770 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-57927f08-7bc4-4a84-9f70-fdf9360d673e" -d '{"events": [{"name": "network-changed", "server_uuid": "5ce49cb3-8d64-40a5-9827-64fa1d2f37c2", "tag": "794847db-0663-47ab-a2b0-4bdedb698598"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:23:44.168323 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:23:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-02fcc919-bdfc-41bf-b866-01692df2d679 x-openstack-request-id: req-02fcc919-bdfc-41bf-b866-01692df2d679 {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:23:44.168611 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5ce49cb3-8d64-40a5-9827-64fa1d2f37c2", "tag": "794847db-0663-47ab-a2b0-4bdedb698598", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:23:44.168862 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-02fcc919-bdfc-41bf-b866-01692df2d679 {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:23:44.169274 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5ce49cb3-8d64-40a5-9827-64fa1d2f37c2', 'tag': '794847db-0663-47ab-a2b0-4bdedb698598', 'status': 'completed', 'code': 200} Nov 08 16:23:44.228384 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-ae32028b-6222-4ae7-a2b2-00187a237f26 None None] Set router f80d01f3-bee2-4682-8f4a-92536ad96209 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:23:44.245484 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57927f08-7bc4-4a84-9f70-fdf9360d673e req-fc06f276-6256-400c-8c14-7942408445b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:23:44.247911 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-57927f08-7bc4-4a84-9f70-fdf9360d673e req-fc06f276-6256-400c-8c14-7942408445b2 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=343d5ca096394f87bea0950aa3811a13&device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 1098 time: 0.0560215 Nov 08 16:23:44.391041 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57927f08-7bc4-4a84-9f70-fdf9360d673e req-18f32a83-acf2-4588-a73e-649d14c835e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:23:44.393036 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-57927f08-7bc4-4a84-9f70-fdf9360d673e req-18f32a83-acf2-4588-a73e-649d14c835e1 service neutron] 10.222.0.25 "GET /v2.0/networks?id=a15e051b-c130-4140-aaf2-a45ea7af5b43 HTTP/1.1" status: 200 len: 913 time: 0.1343102 Nov 08 16:23:44.405644 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a39d9b78-afc5-47d4-bbb1-19e93052cafa req-0a0c2782-e9be-467d-adc3-6a57efb78e95 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:23:44.407210 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a39d9b78-afc5-47d4-bbb1-19e93052cafa req-0a0c2782-e9be-467d-adc3-6a57efb78e95 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 945 time: 0.0702240 Nov 08 16:23:44.446905 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-ae32028b-6222-4ae7-a2b2-00187a237f26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 4, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': 'dbdf39d9-310f-42ea-a1f1-4e1b15048b73', 'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'mac_address': 'fa:16:3e:13:ec:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_interface', 'standard_attr_id': 228, 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:28Z', 'updated_at': '2021-11-08T16:12:32Z', 'revision_number': 5, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'subnets': [{'id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:44.452624 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-57927f08-7bc4-4a84-9f70-fdf9360d673e req-b3ae369d-5937-4e93-b560-7b27c81565d3 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=794847db-0663-47ab-a2b0-4bdedb698598 HTTP/1.1" status: 200 len: 217 time: 0.0444288 Nov 08 16:23:44.480203 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae32028b-6222-4ae7-a2b2-00187a237f26 None None] Checking router: f80d01f3-bee2-4682-8f4a-92536ad96209 for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:23:44.488890 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae32028b-6222-4ae7-a2b2-00187a237f26 None None] Routers {'f80d01f3-bee2-4682-8f4a-92536ad96209'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:23:44.489495 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-ae32028b-6222-4ae7-a2b2-00187a237f26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:23:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['f80d01f3-bee2-4682-8f4a-92536ad96209'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:44.510757 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a39d9b78-afc5-47d4-bbb1-19e93052cafa req-b560f367-a00f-4222-aa3f-edd3bf636719 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/security-groups?id=a52bd5f6-4026-4f07-a3d9-c70ec9af4076&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0971053 Nov 08 16:23:44.534087 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57927f08-7bc4-4a84-9f70-fdf9360d673e req-4cf0a682-893a-4c35-b5ea-af3dd2aa49e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:23:44.534087 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-57927f08-7bc4-4a84-9f70-fdf9360d673e req-4cf0a682-893a-4c35-b5ea-af3dd2aa49e4 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=6e4d65b1-4f2c-453a-847c-970dff985732 HTTP/1.1" status: 200 len: 851 time: 0.0660057 Nov 08 16:23:44.586487 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57927f08-7bc4-4a84-9f70-fdf9360d673e req-a4344ee8-92c1-4985-82a4-bd4d268a6aef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:23:44.588093 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-57927f08-7bc4-4a84-9f70-fdf9360d673e req-a4344ee8-92c1-4985-82a4-bd4d268a6aef service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=a15e051b-c130-4140-aaf2-a45ea7af5b43&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0454700 Nov 08 16:23:44.683871 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-57927f08-7bc4-4a84-9f70-fdf9360d673e req-4bb365d5-845e-4439-8bde-8b5b2f15850c service neutron] 10.222.0.25 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0874686 Nov 08 16:23:44.741753 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-ae32028b-6222-4ae7-a2b2-00187a237f26 None None] Set router f80d01f3-bee2-4682-8f4a-92536ad96209 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:23:44.793402 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-57927f08-7bc4-4a84-9f70-fdf9360d673e req-19af8e41-000e-4ae2-9da1-23f347116760 service neutron] 10.222.0.25 "GET /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0991893 Nov 08 16:23:44.962819 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-ae32028b-6222-4ae7-a2b2-00187a237f26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 4, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': 'dbdf39d9-310f-42ea-a1f1-4e1b15048b73', 'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'mac_address': 'fa:16:3e:13:ec:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_interface', 'standard_attr_id': 228, 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:28Z', 'updated_at': '2021-11-08T16:12:32Z', 'revision_number': 5, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'subnets': [{'id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:44.994715 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae32028b-6222-4ae7-a2b2-00187a237f26 None None] The sync data for ids ['f80d01f3-bee2-4682-8f4a-92536ad96209'] in dv-cinder-816187-2-iscsi is: [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:12:28Z', 'revision_number': 4, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': 'dbdf39d9-310f-42ea-a1f1-4e1b15048b73', 'name': '', 'network_id': 'a15e051b-c130-4140-aaf2-a45ea7af5b43', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'mac_address': 'fa:16:3e:13:ec:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_interface', 'standard_attr_id': 228, 'fixed_ips': [{'subnet_id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:28Z', 'updated_at': '2021-11-08T16:12:32Z', 'revision_number': 5, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'subnets': [{'id': '6e4d65b1-4f2c-453a-847c-970dff985732', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:23:45.082101 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8268e07d-3a96-48a5-9b3b-323bcbe94fba req-533e5d54-38c3-4b5e-aa1e-276f61f78f49 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:23:45.083581 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8268e07d-3a96-48a5-9b3b-323bcbe94fba req-533e5d54-38c3-4b5e-aa1e-276f61f78f49 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.25 "GET /v2.0/ports?device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 945 time: 0.0504606 Nov 08 16:23:45.176929 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-8268e07d-3a96-48a5-9b3b-323bcbe94fba req-dfb23dba-c54b-4dd3-8655-98ef62fe3cae tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Deleting port 794847db-0663-47ab-a2b0-4bdedb698598 {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:23:45.177314 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-8268e07d-3a96-48a5-9b3b-323bcbe94fba req-dfb23dba-c54b-4dd3-8655-98ef62fe3cae tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:45.211006 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-528c853a-d579-4d8a-9c2b-642cd557b530 None None] New status for floating IP f569e85e-1fe4-4f0e-9589-b8abeab39e2b: DOWN {{(pid=101247) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 16:23:45.270437 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-8268e07d-3a96-48a5-9b3b-323bcbe94fba req-dfb23dba-c54b-4dd3-8655-98ef62fe3cae tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] For port 794847db-0663-47ab-a2b0-4bdedb698598, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=794847db-0663-47ab-a2b0-4bdedb698598,segment=NetworkSegment(1383b9f8-d178-4a90-828c-184fa1886253),segment_id=1383b9f8-d178-4a90-828c-184fa1886253)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:23:45.270837 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-8268e07d-3a96-48a5-9b3b-323bcbe94fba req-dfb23dba-c54b-4dd3-8655-98ef62fe3cae tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:45.284150 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-8268e07d-3a96-48a5-9b3b-323bcbe94fba req-dfb23dba-c54b-4dd3-8655-98ef62fe3cae tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling delete_port for 794847db-0663-47ab-a2b0-4bdedb698598 owned by compute:nova {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:23:45.409605 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-8268e07d-3a96-48a5-9b3b-323bcbe94fba req-dfb23dba-c54b-4dd3-8655-98ef62fe3cae tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:45.436395 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfb23dba-c54b-4dd3-8655-98ef62fe3cae tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Pushing event deleted for resources: {'Port': ['ID=794847db-0663-47ab-a2b0-4bdedb698598,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:45.475521 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-8268e07d-3a96-48a5-9b3b-323bcbe94fba req-dfb23dba-c54b-4dd3-8655-98ef62fe3cae tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] No DVR routers for this DVR port 794847db-0663-47ab-a2b0-4bdedb698598 on host hv-cinder-81618 {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:23:45.477851 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-8268e07d-3a96-48a5-9b3b-323bcbe94fba req-dfb23dba-c54b-4dd3-8655-98ef62fe3cae tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:45.481099 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8268e07d-3a96-48a5-9b3b-323bcbe94fba req-dfb23dba-c54b-4dd3-8655-98ef62fe3cae tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.25 "DELETE /v2.0/ports/794847db-0663-47ab-a2b0-4bdedb698598 HTTP/1.1" status: 204 len: 173 time: 0.3904932 Nov 08 16:23:45.612963 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5f39373d-c9cf-4dc6-9d60-582e1fa81665 req-7a8036cd-1cee-489d-9f9a-cb6fab0a844c tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "GET /v2.0/ports?device_id=5ce49cb3-8d64-40a5-9827-64fa1d2f37c2 HTTP/1.1" status: 200 len: 210 time: 0.0258946 Nov 08 16:23:46.170951 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5ce49cb3-8d64-40a5-9827-64fa1d2f37c2', 'name': 'network-vif-deleted', 'tag': '794847db-0663-47ab-a2b0-4bdedb698598'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:23:46.174503 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-16f01697-78d1-4595-bf30-042e77dd6169" -d '{"events": [{"server_uuid": "5ce49cb3-8d64-40a5-9827-64fa1d2f37c2", "name": "network-vif-deleted", "tag": "794847db-0663-47ab-a2b0-4bdedb698598"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:23:46.221302 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:23:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3d7fb718-41be-4429-9397-2e52144cad3d x-openstack-request-id: req-3d7fb718-41be-4429-9397-2e52144cad3d {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:23:46.221630 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5ce49cb3-8d64-40a5-9827-64fa1d2f37c2", "name": "network-vif-deleted", "tag": "794847db-0663-47ab-a2b0-4bdedb698598", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:23:46.222050 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-3d7fb718-41be-4429-9397-2e52144cad3d {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:23:46.222574 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5ce49cb3-8d64-40a5-9827-64fa1d2f37c2', 'name': 'network-vif-deleted', 'tag': '794847db-0663-47ab-a2b0-4bdedb698598', 'status': 'completed', 'code': 200} Nov 08 16:23:46.666482 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43220) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:46.785961 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-6c3e5007-2969-49b1-abfd-82012a9d3d95 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Deleting port 41e0a3c4-8827-4e58-9974-cbbe38a57389 {{(pid=101245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:23:46.786297 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6c3e5007-2969-49b1-abfd-82012a9d3d95 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:46.861459 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6c3e5007-2969-49b1-abfd-82012a9d3d95 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:46.861803 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6c3e5007-2969-49b1-abfd-82012a9d3d95 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:46.873333 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-6c3e5007-2969-49b1-abfd-82012a9d3d95 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Calling delete_port for 41e0a3c4-8827-4e58-9974-cbbe38a57389 owned by network:floatingip {{(pid=101245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:23:46.998599 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6c3e5007-2969-49b1-abfd-82012a9d3d95 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:47.023530 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c3e5007-2969-49b1-abfd-82012a9d3d95 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Pushing event deleted for resources: {'Port': ['ID=41e0a3c4-8827-4e58-9974-cbbe38a57389,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:47.080182 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6c3e5007-2969-49b1-abfd-82012a9d3d95 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for floatingip, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:47.082718 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-6c3e5007-2969-49b1-abfd-82012a9d3d95 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for floatingip, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:47.083857 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-6c3e5007-2969-49b1-abfd-82012a9d3d95 tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "DELETE /v2.0/floatingips/a86b2433-a749-44fc-91a7-e9bec1465b20 HTTP/1.1" status: 204 len: 168 time: 0.4164128 Nov 08 16:23:49.751107 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:49.866740 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 794847db-0663-47ab-a2b0-4bdedb698598 no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:23:49.886567 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] No Port match for: 794847db-0663-47ab-a2b0-4bdedb698598 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:23:49.886889 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 794847db-0663-47ab-a2b0-4bdedb698598 not bound to the agent host hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:23:50.357127 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43250) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:50.413282 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4cfdc389-34fb-4155-90e5-be9710fdf27e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:50.438569 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4cfdc389-34fb-4155-90e5-be9710fdf27e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:50.510295 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4cfdc389-34fb-4155-90e5-be9710fdf27e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:50.512988 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4cfdc389-34fb-4155-90e5-be9710fdf27e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:50.517173 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-4cfdc389-34fb-4155-90e5-be9710fdf27e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] 10.222.0.37 "DELETE /v2.0/security-groups/a52bd5f6-4026-4f07-a3d9-c70ec9af4076 HTTP/1.1" status: 204 len: 168 time: 0.1559961 Nov 08 16:23:50.527172 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cfdc389-34fb-4155-90e5-be9710fdf27e tempest-TestVolumeBootPattern-303720373 tempest-TestVolumeBootPattern-303720373-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a52bd5f6-4026-4f07-a3d9-c70ec9af4076,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:50.575136 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 43268) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:51.048690 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-348de56f-f6e6-4597-be37-ce872dc1bf8e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-2033295'] for router_interface, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:51.281120 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-348de56f-f6e6-4597-be37-ce872dc1bf8e admin admin] Deleting port dbdf39d9-310f-42ea-a1f1-4e1b15048b73 {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:23:51.281448 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-348de56f-f6e6-4597-be37-ce872dc1bf8e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:51.354492 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [None req-348de56f-f6e6-4597-be37-ce872dc1bf8e admin admin] For port dbdf39d9-310f-42ea-a1f1-4e1b15048b73, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=dbdf39d9-310f-42ea-a1f1-4e1b15048b73,segment=NetworkSegment(1383b9f8-d178-4a90-828c-184fa1886253),segment_id=1383b9f8-d178-4a90-828c-184fa1886253)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:23:51.354761 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-348de56f-f6e6-4597-be37-ce872dc1bf8e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:51.371207 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-348de56f-f6e6-4597-be37-ce872dc1bf8e admin admin] Calling delete_port for dbdf39d9-310f-42ea-a1f1-4e1b15048b73 owned by network:router_interface {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:23:51.540876 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-348de56f-f6e6-4597-be37-ce872dc1bf8e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:51.809696 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-348de56f-f6e6-4597-be37-ce872dc1bf8e admin admin] Pushing event deleted for resources: {'Port': ['ID=dbdf39d9-310f-42ea-a1f1-4e1b15048b73,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:51.974095 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-348de56f-f6e6-4597-be37-ce872dc1bf8e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1599532', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-2034495'] for router_interface, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:52.181255 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-348de56f-f6e6-4597-be37-ce872dc1bf8e admin admin] Router f80d01f3-bee2-4682-8f4a-92536ad96209 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:23:52.282499 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-348de56f-f6e6-4597-be37-ce872dc1bf8e admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:23:52.287410 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-348de56f-f6e6-4597-be37-ce872dc1bf8e admin admin] 10.222.0.37 "PUT /v2.0/routers/f80d01f3-bee2-4682-8f4a-92536ad96209/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7112229 Nov 08 16:23:52.290063 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43284) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:52.291160 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bcd15c31-6e12-4d3e-bfe3-19ad84aa766f None None] Sync routers for ids ['f80d01f3-bee2-4682-8f4a-92536ad96209'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:23:52.301700 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bcd15c31-6e12-4d3e-bfe3-19ad84aa766f None None] Routers {'f80d01f3-bee2-4682-8f4a-92536ad96209'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:23:52.302409 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-bcd15c31-6e12-4d3e-bfe3-19ad84aa766f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:23:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['f80d01f3-bee2-4682-8f4a-92536ad96209'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:52.390545 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1baf9e15-0942-481d-8e71-b1e63d63e4ab admin admin] Publish callbacks [] for router, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:52.403793 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-bcd15c31-6e12-4d3e-bfe3-19ad84aa766f None None] Set router f80d01f3-bee2-4682-8f4a-92536ad96209 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:23:52.489293 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1baf9e15-0942-481d-8e71-b1e63d63e4ab admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:52.539222 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-1baf9e15-0942-481d-8e71-b1e63d63e4ab admin admin] Deleting port e49748a3-436b-4a68-b6ec-fe25b219855e {{(pid=101245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:23:52.539550 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1baf9e15-0942-481d-8e71-b1e63d63e4ab admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:52.579391 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-bcd15c31-6e12-4d3e-bfe3-19ad84aa766f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:23:51Z', 'revision_number': 5, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port': {'id': 'e49748a3-436b-4a68-b6ec-fe25b219855e', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b6:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'device_owner': 'network:router_gateway', 'standard_attr_id': 227, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:26Z', 'updated_at': '2021-11-08T16:12:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:52.605958 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bcd15c31-6e12-4d3e-bfe3-19ad84aa766f None None] Checking router: f80d01f3-bee2-4682-8f4a-92536ad96209 for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:23:52.614588 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bcd15c31-6e12-4d3e-bfe3-19ad84aa766f None None] Routers {'f80d01f3-bee2-4682-8f4a-92536ad96209'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:23:52.615186 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-bcd15c31-6e12-4d3e-bfe3-19ad84aa766f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:23:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['f80d01f3-bee2-4682-8f4a-92536ad96209'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:52.615839 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [None req-1baf9e15-0942-481d-8e71-b1e63d63e4ab admin admin] For port e49748a3-436b-4a68-b6ec-fe25b219855e, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=e49748a3-436b-4a68-b6ec-fe25b219855e,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:23:52.616194 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1baf9e15-0942-481d-8e71-b1e63d63e4ab admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:52.628825 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-1baf9e15-0942-481d-8e71-b1e63d63e4ab admin admin] Calling delete_port for e49748a3-436b-4a68-b6ec-fe25b219855e owned by network:router_gateway {{(pid=101245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:23:52.697981 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-bcd15c31-6e12-4d3e-bfe3-19ad84aa766f None None] Set router f80d01f3-bee2-4682-8f4a-92536ad96209 gateway port host: None {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:23:52.748500 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-bcd15c31-6e12-4d3e-bfe3-19ad84aa766f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:23:52Z', 'revision_number': 6, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port_host': None}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:52.777317 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bcd15c31-6e12-4d3e-bfe3-19ad84aa766f None None] The sync data for ids ['f80d01f3-bee2-4682-8f4a-92536ad96209'] in dv-cinder-816187-2-iscsi is: [{'id': 'f80d01f3-bee2-4682-8f4a-92536ad96209', 'name': 'tempest-TestVolumeBootPattern-1161956130-router', 'tenant_id': '343d5ca096394f87bea0950aa3811a13', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:25Z', 'updated_at': '2021-11-08T16:23:52Z', 'revision_number': 6, 'project_id': '343d5ca096394f87bea0950aa3811a13', 'gw_port_host': None}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:23:52.791739 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1baf9e15-0942-481d-8e71-b1e63d63e4ab admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:52.821979 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1baf9e15-0942-481d-8e71-b1e63d63e4ab admin admin] Pushing event deleted for resources: {'Port': ['ID=e49748a3-436b-4a68-b6ec-fe25b219855e,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:52.883012 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1baf9e15-0942-481d-8e71-b1e63d63e4ab admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-2032325'] for router_gateway, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:52.971763 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1baf9e15-0942-481d-8e71-b1e63d63e4ab admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-2034023', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-12866'] for router, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:52.974086 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1baf9e15-0942-481d-8e71-b1e63d63e4ab admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.016108 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1baf9e15-0942-481d-8e71-b1e63d63e4ab admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-2034044'] for router, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.016680 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1baf9e15-0942-481d-8e71-b1e63d63e4ab admin admin] Fanout notify agent at l3_agent the message router_deleted on router f80d01f3-bee2-4682-8f4a-92536ad96209 {{(pid=101245) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 08 16:23:53.020849 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-1baf9e15-0942-481d-8e71-b1e63d63e4ab admin admin] Publish callbacks [] for router, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.024317 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-1baf9e15-0942-481d-8e71-b1e63d63e4ab admin admin] 10.222.0.37 "DELETE /v2.0/routers/f80d01f3-bee2-4682-8f4a-92536ad96209 HTTP/1.1" status: 204 len: 168 time: 0.7309520 Nov 08 16:23:53.024521 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43302) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:53.071133 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_v2 [None req-e45f40b2-11e2-448e-af7a-6f5cf468137f admin admin] Deleting subnet 6e4d65b1-4f2c-453a-847c-970dff985732 {{(pid=101245) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 16:23:53.074195 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e45f40b2-11e2-448e-af7a-6f5cf468137f admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.094923 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43304) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:53.116014 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e45f40b2-11e2-448e-af7a-6f5cf468137f admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5113603'] for subnet, precommit_delete_associations {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.194708 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e45f40b2-11e2-448e-af7a-6f5cf468137f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-872226'] for subnet, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.236820 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-725915f4-e436-4f0d-bcc8-3ab0266f6fb8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.286461 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e45f40b2-11e2-448e-af7a-6f5cf468137f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-872235', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7464090', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6098572'] for subnet, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.320725 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e45f40b2-11e2-448e-af7a-6f5cf468137f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6e4d65b1-4f2c-453a-847c-970dff985732,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:53.323800 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-e45f40b2-11e2-448e-af7a-6f5cf468137f admin admin] Publish callbacks [] for subnet, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.326334 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4db7d9f-cfe5-4607-98d4-51f4e0940686 None None] Network a15e051b-c130-4140-aaf2-a45ea7af5b43 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:23:53.327210 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-e45f40b2-11e2-448e-af7a-6f5cf468137f admin admin] 10.222.0.37 "DELETE /v2.0/subnets/6e4d65b1-4f2c-453a-847c-970dff985732 HTTP/1.1" status: 204 len: 168 time: 0.3016651 Nov 08 16:23:53.330158 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 43308) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:53.366236 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-725915f4-e436-4f0d-bcc8-3ab0266f6fb8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.372024 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-725915f4-e436-4f0d-bcc8-3ab0266f6fb8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.405936 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-036c38fc-f552-47de-8c19-b73a97ba795f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1007047'] for network, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.424925 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-725915f4-e436-4f0d-bcc8-3ab0266f6fb8 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=a9b2a489e6db415286c7f902b60953bd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3289516 Nov 08 16:23:53.425830 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43310) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:53.432797 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-725915f4-e436-4f0d-bcc8-3ab0266f6fb8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5f686c35-d248-49dc-bb1c-510cac54765d,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:53.474317 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-036c38fc-f552-47de-8c19-b73a97ba795f admin admin] Deleting port 7242f5d5-9392-463d-9719-fe795bec2e7c {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:23:53.475556 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-036c38fc-f552-47de-8c19-b73a97ba795f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.480046 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-78079e8e-fd2f-40af-b3fd-45cecdf8c107 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.520689 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-78079e8e-fd2f-40af-b3fd-45cecdf8c107 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.543299 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [None req-036c38fc-f552-47de-8c19-b73a97ba795f admin admin] For port 7242f5d5-9392-463d-9719-fe795bec2e7c, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=7242f5d5-9392-463d-9719-fe795bec2e7c,segment=NetworkSegment(1383b9f8-d178-4a90-828c-184fa1886253),segment_id=1383b9f8-d178-4a90-828c-184fa1886253)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:23:53.543803 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-036c38fc-f552-47de-8c19-b73a97ba795f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.558576 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-036c38fc-f552-47de-8c19-b73a97ba795f admin admin] Calling delete_port for 7242f5d5-9392-463d-9719-fe795bec2e7c owned by network:dhcp {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:23:53.574184 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-78079e8e-fd2f-40af-b3fd-45cecdf8c107 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.576779 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-78079e8e-fd2f-40af-b3fd-45cecdf8c107 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.577946 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-78079e8e-fd2f-40af-b3fd-45cecdf8c107 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/5f686c35-d248-49dc-bb1c-510cac54765d HTTP/1.1" status: 204 len: 168 time: 0.1511974 Nov 08 16:23:53.596039 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6906770a-a21f-4a54-8545-7d589c38574d None None] DHCP port deletion for a15e051b-c130-4140-aaf2-a45ea7af5b43 request from dv-cinder-816187-2-iscsi {{(pid=101246) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 08 16:23:53.598744 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78079e8e-fd2f-40af-b3fd-45cecdf8c107 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5f686c35-d248-49dc-bb1c-510cac54765d,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:53.652673 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-036c38fc-f552-47de-8c19-b73a97ba795f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.665920 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6906770a-a21f-4a54-8545-7d589c38574d None None] Deleting port 7242f5d5-9392-463d-9719-fe795bec2e7c {{(pid=101246) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:23:53.666293 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6906770a-a21f-4a54-8545-7d589c38574d None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.686726 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-036c38fc-f552-47de-8c19-b73a97ba795f admin admin] Pushing event deleted for resources: {'Port': ['ID=7242f5d5-9392-463d-9719-fe795bec2e7c,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:53.690799 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-036c38fc-f552-47de-8c19-b73a97ba795f admin admin] No DVR routers for this DVR port 7242f5d5-9392-463d-9719-fe795bec2e7c on host dv-cinder-816187-2-iscsi {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:23:53.742088 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-6906770a-a21f-4a54-8545-7d589c38574d None None] For port 7242f5d5-9392-463d-9719-fe795bec2e7c, host dv-cinder-816187-2-iscsi, got binding levels [] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:23:53.742471 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6906770a-a21f-4a54-8545-7d589c38574d None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.762125 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6906770a-a21f-4a54-8545-7d589c38574d None None] Calling delete_port for 7242f5d5-9392-463d-9719-fe795bec2e7c owned by network:dhcp {{(pid=101246) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:23:53.764681 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.ipam_backend_mixin [None req-6906770a-a21f-4a54-8545-7d589c38574d None None] Port 7242f5d5-9392-463d-9719-fe795bec2e7c was not found and therefore no delete operation was performed {{(pid=101246) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 08 16:23:53.764816 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-036c38fc-f552-47de-8c19-b73a97ba795f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-869719', 'neutron.services.segments.db._delete_segments_for_network-8792877333297'] for network, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.766877 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6906770a-a21f-4a54-8545-7d589c38574d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364'] for port, after_delete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.778929 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6906770a-a21f-4a54-8545-7d589c38574d None None] No DVR routers for this DVR port 7242f5d5-9392-463d-9719-fe795bec2e7c on host dv-cinder-816187-2-iscsi {{(pid=101246) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:23:53.790026 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-036c38fc-f552-47de-8c19-b73a97ba795f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a15e051b-c130-4140-aaf2-a45ea7af5b43']}} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:53.797675 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6906770a-a21f-4a54-8545-7d589c38574d None None] Pushing event deleted for resources: {'Port': ['ID=7242f5d5-9392-463d-9719-fe795bec2e7c,revision_number=None']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:53.802518 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-036c38fc-f552-47de-8c19-b73a97ba795f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1383b9f8-d178-4a90-828c-184fa1886253') {'for_net_delete': True} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:53.802518 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-036c38fc-f552-47de-8c19-b73a97ba795f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1383b9f8-d178-4a90-828c-184fa1886253') {} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:53.812610 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-036c38fc-f552-47de-8c19-b73a97ba795f admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792877333818', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8047118'] for segment, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.827050 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-036c38fc-f552-47de-8c19-b73a97ba795f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.837638 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-036c38fc-f552-47de-8c19-b73a97ba795f admin admin] Releasing vlan 161 on physical network physnet1 to pool {{(pid=101244) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 16:23:53.838264 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-036c38fc-f552-47de-8c19-b73a97ba795f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4227628'] for segment, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: Traceback (most recent call last): Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: timer() Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: cb(*args, **kw) Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: return func(*args, **kwargs) Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: self._notify() Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: self.callback(batched_events) Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: event.method(event) Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: return f(self, *a, **k) Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: return self._get(url).json() Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: return self.request(url, 'GET', **kwargs) Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 16:23:53.840229 dv-cinder-816187-2-iscsi neutron-server[101244]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 16:23:53.908086 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device e49748a3-436b-4a68-b6ec-fe25b219855e no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:23:53.925438 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-036c38fc-f552-47de-8c19-b73a97ba795f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-868772', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-2032313'] for network, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.941278 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: e49748a3-436b-4a68-b6ec-fe25b219855e {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:23:53.941574 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device e49748a3-436b-4a68-b6ec-fe25b219855e not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:23:53.942032 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device dbdf39d9-310f-42ea-a1f1-4e1b15048b73 no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:23:53.959794 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-036c38fc-f552-47de-8c19-b73a97ba795f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:53.965652 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-036c38fc-f552-47de-8c19-b73a97ba795f admin admin] 10.222.0.37 "DELETE /v2.0/networks/a15e051b-c130-4140-aaf2-a45ea7af5b43 HTTP/1.1" status: 204 len: 168 time: 0.6314392 Nov 08 16:23:53.965652 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-036c38fc-f552-47de-8c19-b73a97ba795f admin admin] Pushing event deleted for resources: {'Network': ['ID=a15e051b-c130-4140-aaf2-a45ea7af5b43,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:53.967854 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43322) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:53.970959 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: dbdf39d9-310f-42ea-a1f1-4e1b15048b73 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:23:53.971325 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device dbdf39d9-310f-42ea-a1f1-4e1b15048b73 not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:23:53.971902 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 7242f5d5-9392-463d-9719-fe795bec2e7c no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:23:53.996327 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: 7242f5d5-9392-463d-9719-fe795bec2e7c {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:23:53.996327 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 7242f5d5-9392-463d-9719-fe795bec2e7c not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:23:54.318652 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-16a81c7b-3890-4494-b091-c072397e74a5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-2033295'] for router_interface, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:54.558575 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-16a81c7b-3890-4494-b091-c072397e74a5 admin admin] Deleting port f275a781-b489-47a1-9715-eeec487362a2 {{(pid=101245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:23:54.559164 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-16a81c7b-3890-4494-b091-c072397e74a5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:54.639420 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [None req-16a81c7b-3890-4494-b091-c072397e74a5 admin admin] For port f275a781-b489-47a1-9715-eeec487362a2, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=f275a781-b489-47a1-9715-eeec487362a2,segment=NetworkSegment(1c3a289d-7f6e-4095-81e3-d89c2b08dba0),segment_id=1c3a289d-7f6e-4095-81e3-d89c2b08dba0)] {{(pid=101245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:23:54.639772 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-16a81c7b-3890-4494-b091-c072397e74a5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:54.652558 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-16a81c7b-3890-4494-b091-c072397e74a5 admin admin] Calling delete_port for f275a781-b489-47a1-9715-eeec487362a2 owned by network:router_interface {{(pid=101245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:23:54.825647 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-16a81c7b-3890-4494-b091-c072397e74a5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:54.850145 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16a81c7b-3890-4494-b091-c072397e74a5 admin admin] Pushing event deleted for resources: {'Port': ['ID=f275a781-b489-47a1-9715-eeec487362a2,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:55.205269 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 43352) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:55.270322 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-16a81c7b-3890-4494-b091-c072397e74a5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1599532', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-2034495'] for router_interface, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:55.346763 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f6b1d076-b381-4585-b9d9-ac500b97fd11 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:55.419958 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f6b1d076-b381-4585-b9d9-ac500b97fd11 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:55.424611 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-f6b1d076-b381-4585-b9d9-ac500b97fd11 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:55.461406 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-f6b1d076-b381-4585-b9d9-ac500b97fd11 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=443dd7517ebf433aacce3bdbbe7406e4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2549965 Nov 08 16:23:55.462395 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6b1d076-b381-4585-b9d9-ac500b97fd11 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d06877a5-eeec-44bc-97f2-61d9c935f9ca,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:55.464731 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 43356) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:55.484324 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-16a81c7b-3890-4494-b091-c072397e74a5 admin admin] Router 3a49b33e-62d5-487b-ada9-a5dcfad92e31 has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101245) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:23:55.518006 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d32a9a56-cc3c-434a-bfc8-ea2374677d79 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:55.538816 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d32a9a56-cc3c-434a-bfc8-ea2374677d79 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:55.586186 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d32a9a56-cc3c-434a-bfc8-ea2374677d79 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:55.586407 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-16a81c7b-3890-4494-b091-c072397e74a5 admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101245) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:23:55.588732 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d32a9a56-cc3c-434a-bfc8-ea2374677d79 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:55.595224 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-d32a9a56-cc3c-434a-bfc8-ea2374677d79 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/d06877a5-eeec-44bc-97f2-61d9c935f9ca HTTP/1.1" status: 204 len: 168 time: 0.1241863 Nov 08 16:23:55.596174 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-16a81c7b-3890-4494-b091-c072397e74a5 admin admin] 10.222.0.37 "PUT /v2.0/routers/3a49b33e-62d5-487b-ada9-a5dcfad92e31/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6216760 Nov 08 16:23:55.596280 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 43358) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:55.599201 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f088f0f1-c253-4e59-96db-23a5de6820ba None None] Sync routers for ids ['3a49b33e-62d5-487b-ada9-a5dcfad92e31'] in dv-cinder-816187-2-iscsi {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:23:55.640885 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d32a9a56-cc3c-434a-bfc8-ea2374677d79 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d06877a5-eeec-44bc-97f2-61d9c935f9ca,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:55.709154 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f088f0f1-c253-4e59-96db-23a5de6820ba None None] Routers {'3a49b33e-62d5-487b-ada9-a5dcfad92e31'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:23:55.709786 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-f088f0f1-c253-4e59-96db-23a5de6820ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:23:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['3a49b33e-62d5-487b-ada9-a5dcfad92e31'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:55.724868 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-885c01c7-1389-4915-ab1e-d3eae4b9d721 admin admin] Publish callbacks [] for router, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:55.814366 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-f088f0f1-c253-4e59-96db-23a5de6820ba None None] Set router 3a49b33e-62d5-487b-ada9-a5dcfad92e31 gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:23:55.841328 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-885c01c7-1389-4915-ab1e-d3eae4b9d721 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:55.903349 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-885c01c7-1389-4915-ab1e-d3eae4b9d721 admin admin] Deleting port 8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8 {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:23:55.903720 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-885c01c7-1389-4915-ab1e-d3eae4b9d721 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:55.921014 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43364) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:55.937261 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-93294a0b-0d08-429d-af48-3a96a338801b admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:55.990650 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [None req-885c01c7-1389-4915-ab1e-d3eae4b9d721 admin admin] For port 8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:23:55.991067 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-885c01c7-1389-4915-ab1e-d3eae4b9d721 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:56.004095 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-f088f0f1-c253-4e59-96db-23a5de6820ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a49b33e-62d5-487b-ada9-a5dcfad92e31', 'name': 'tempest-TestVolumeBootPattern-931662474-router', 'tenant_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.79'}], 'enable_snat': True}, 'gw_port_id': '8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:30Z', 'updated_at': '2021-11-08T16:23:54Z', 'revision_number': 5, 'project_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'gw_port': {'id': '8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:fc:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a49b33e-62d5-487b-ada9-a5dcfad92e31', 'device_owner': 'network:router_gateway', 'standard_attr_id': 239, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.79', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:12:31Z', 'updated_at': '2021-11-08T16:12:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:56.012001 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-885c01c7-1389-4915-ab1e-d3eae4b9d721 admin admin] Calling delete_port for 8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8 owned by network:router_gateway {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:23:56.019606 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-93294a0b-0d08-429d-af48-3a96a338801b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:56.024268 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-93294a0b-0d08-429d-af48-3a96a338801b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:56.035495 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f088f0f1-c253-4e59-96db-23a5de6820ba None None] Checking router: 3a49b33e-62d5-487b-ada9-a5dcfad92e31 for host: dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:23:56.043646 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f088f0f1-c253-4e59-96db-23a5de6820ba None None] Routers {'3a49b33e-62d5-487b-ada9-a5dcfad92e31'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:23:56.044323 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-f088f0f1-c253-4e59-96db-23a5de6820ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:23:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['3a49b33e-62d5-487b-ada9-a5dcfad92e31'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:56.064842 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-93294a0b-0d08-429d-af48-3a96a338801b admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=f14d94b34897493a8933d78477930b6a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1403332 Nov 08 16:23:56.064842 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93294a0b-0d08-429d-af48-3a96a338801b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e4b7a935-80aa-441c-ae56-877c5e436a72,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:56.065557 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 43366) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:56.128247 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-f088f0f1-c253-4e59-96db-23a5de6820ba None None] Set router 3a49b33e-62d5-487b-ada9-a5dcfad92e31 gateway port host: None {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:23:56.164718 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-fb98c327-990d-46f0-965a-d95e629c5135 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:56.180271 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-f088f0f1-c253-4e59-96db-23a5de6820ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a49b33e-62d5-487b-ada9-a5dcfad92e31', 'name': 'tempest-TestVolumeBootPattern-931662474-router', 'tenant_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:30Z', 'updated_at': '2021-11-08T16:23:55Z', 'revision_number': 6, 'project_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'gw_port_host': None}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:56.195965 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-fb98c327-990d-46f0-965a-d95e629c5135 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:56.207718 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f088f0f1-c253-4e59-96db-23a5de6820ba None None] The sync data for ids ['3a49b33e-62d5-487b-ada9-a5dcfad92e31'] in dv-cinder-816187-2-iscsi is: [{'id': '3a49b33e-62d5-487b-ada9-a5dcfad92e31', 'name': 'tempest-TestVolumeBootPattern-931662474-router', 'tenant_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:12:30Z', 'updated_at': '2021-11-08T16:23:55Z', 'revision_number': 6, 'project_id': 'b8c79a72977c4451b0c2fb13bbce6425', 'gw_port_host': None}] {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:23:56.270284 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-885c01c7-1389-4915-ab1e-d3eae4b9d721 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:56.297419 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-fb98c327-990d-46f0-965a-d95e629c5135 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:56.299914 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-fb98c327-990d-46f0-965a-d95e629c5135 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:56.301022 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-fb98c327-990d-46f0-965a-d95e629c5135 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/e4b7a935-80aa-441c-ae56-877c5e436a72 HTTP/1.1" status: 204 len: 168 time: 0.2343392 Nov 08 16:23:56.303546 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-885c01c7-1389-4915-ab1e-d3eae4b9d721 admin admin] Pushing event deleted for resources: {'Port': ['ID=8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:56.316457 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb98c327-990d-46f0-965a-d95e629c5135 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e4b7a935-80aa-441c-ae56-877c5e436a72,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:56.370087 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-885c01c7-1389-4915-ab1e-d3eae4b9d721 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-2032325'] for router_gateway, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:56.461327 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-885c01c7-1389-4915-ab1e-d3eae4b9d721 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-2034023', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-12866'] for router, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:56.463603 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-885c01c7-1389-4915-ab1e-d3eae4b9d721 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:56.505925 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-885c01c7-1389-4915-ab1e-d3eae4b9d721 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-2034044'] for router, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:56.506453 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-885c01c7-1389-4915-ab1e-d3eae4b9d721 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3a49b33e-62d5-487b-ada9-a5dcfad92e31 {{(pid=101244) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 08 16:23:56.510769 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-885c01c7-1389-4915-ab1e-d3eae4b9d721 admin admin] Publish callbacks [] for router, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:56.512037 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-885c01c7-1389-4915-ab1e-d3eae4b9d721 admin admin] 10.222.0.37 "DELETE /v2.0/routers/3a49b33e-62d5-487b-ada9-a5dcfad92e31 HTTP/1.1" status: 204 len: 168 time: 0.9167616 Nov 08 16:23:56.514581 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 43372) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:56.558318 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_v2 [None req-9b4bcb6f-61a2-4cb5-8f51-fbc12ec42826 admin admin] Deleting subnet bb937a91-aa49-4e37-bf83-705c857a3885 {{(pid=101244) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 16:23:56.561696 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9b4bcb6f-61a2-4cb5-8f51-fbc12ec42826 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:56.601537 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9b4bcb6f-61a2-4cb5-8f51-fbc12ec42826 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8047127'] for subnet, precommit_delete_associations {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:56.691094 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9b4bcb6f-61a2-4cb5-8f51-fbc12ec42826 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-872226'] for subnet, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:56.742737 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9b4bcb6f-61a2-4cb5-8f51-fbc12ec42826 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-872235', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4227786', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4279947'] for subnet, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:56.772245 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-9b4bcb6f-61a2-4cb5-8f51-fbc12ec42826 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for subnet, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:56.776420 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-9b4bcb6f-61a2-4cb5-8f51-fbc12ec42826 admin admin] 10.222.0.37 "DELETE /v2.0/subnets/bb937a91-aa49-4e37-bf83-705c857a3885 HTTP/1.1" status: 204 len: 168 time: 0.2605133 Nov 08 16:23:56.777403 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b4bcb6f-61a2-4cb5-8f51-fbc12ec42826 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=bb937a91-aa49-4e37-bf83-705c857a3885,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:56.777871 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-73a1d4cd-87bd-459d-a269-b2b772545b88 None None] Network 840ec990-538f-47e9-ab6a-3f378aa5803e requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:23:56.778761 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43382) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:56.855233 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ed5e5560-b4a2-4246-8738-7579a435d372 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1007047'] for network, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:56.916121 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-ed5e5560-b4a2-4246-8738-7579a435d372 admin admin] Deleting port 80170e07-aa47-42c5-8b3a-7eaefdd07f69 {{(pid=101245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:23:56.916464 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ed5e5560-b4a2-4246-8738-7579a435d372 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:56.981476 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [None req-ed5e5560-b4a2-4246-8738-7579a435d372 admin admin] For port 80170e07-aa47-42c5-8b3a-7eaefdd07f69, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=80170e07-aa47-42c5-8b3a-7eaefdd07f69,segment=NetworkSegment(1c3a289d-7f6e-4095-81e3-d89c2b08dba0),segment_id=1c3a289d-7f6e-4095-81e3-d89c2b08dba0)] {{(pid=101245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:23:56.981897 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ed5e5560-b4a2-4246-8738-7579a435d372 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:56.995682 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-ed5e5560-b4a2-4246-8738-7579a435d372 admin admin] Calling delete_port for 80170e07-aa47-42c5-8b3a-7eaefdd07f69 owned by network:dhcp {{(pid=101245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:23:57.006267 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad1f32a7-ca12-418b-bb93-b2e1bb655b29 None None] DHCP port deletion for 840ec990-538f-47e9-ab6a-3f378aa5803e request from dv-cinder-816187-2-iscsi {{(pid=101246) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 08 16:23:57.075939 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-ad1f32a7-ca12-418b-bb93-b2e1bb655b29 None None] Deleting port 80170e07-aa47-42c5-8b3a-7eaefdd07f69 {{(pid=101246) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:23:57.076668 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ad1f32a7-ca12-418b-bb93-b2e1bb655b29 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:57.077534 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ed5e5560-b4a2-4246-8738-7579a435d372 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:57.111068 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed5e5560-b4a2-4246-8738-7579a435d372 admin admin] Pushing event deleted for resources: {'Port': ['ID=80170e07-aa47-42c5-8b3a-7eaefdd07f69,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:57.120505 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed5e5560-b4a2-4246-8738-7579a435d372 admin admin] No DVR routers for this DVR port 80170e07-aa47-42c5-8b3a-7eaefdd07f69 on host dv-cinder-816187-2-iscsi {{(pid=101245) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:23:57.151228 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-ad1f32a7-ca12-418b-bb93-b2e1bb655b29 None None] For port 80170e07-aa47-42c5-8b3a-7eaefdd07f69, host dv-cinder-816187-2-iscsi, got binding levels [] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:23:57.151769 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ad1f32a7-ca12-418b-bb93-b2e1bb655b29 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:57.169443 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-ad1f32a7-ca12-418b-bb93-b2e1bb655b29 None None] Calling delete_port for 80170e07-aa47-42c5-8b3a-7eaefdd07f69 owned by network:dhcp {{(pid=101246) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:23:57.172408 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.ipam_backend_mixin [None req-ad1f32a7-ca12-418b-bb93-b2e1bb655b29 None None] Port 80170e07-aa47-42c5-8b3a-7eaefdd07f69 was not found and therefore no delete operation was performed {{(pid=101246) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 08 16:23:57.173980 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ad1f32a7-ca12-418b-bb93-b2e1bb655b29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364'] for port, after_delete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:57.200996 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad1f32a7-ca12-418b-bb93-b2e1bb655b29 None None] Pushing event deleted for resources: {'Port': ['ID=80170e07-aa47-42c5-8b3a-7eaefdd07f69,revision_number=None']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:57.204504 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad1f32a7-ca12-418b-bb93-b2e1bb655b29 None None] No DVR routers for this DVR port 80170e07-aa47-42c5-8b3a-7eaefdd07f69 on host dv-cinder-816187-2-iscsi {{(pid=101246) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:23:57.208724 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ed5e5560-b4a2-4246-8738-7579a435d372 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-869719', 'neutron.services.segments.db._delete_segments_for_network-8792877333297'] for network, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:57.235465 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.services.segments.db [None req-ed5e5560-b4a2-4246-8738-7579a435d372 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['840ec990-538f-47e9-ab6a-3f378aa5803e']}} {{(pid=101245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:57.245922 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.services.segments.db [None req-ed5e5560-b4a2-4246-8738-7579a435d372 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1c3a289d-7f6e-4095-81e3-d89c2b08dba0') {'for_net_delete': True} {{(pid=101245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:57.246461 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.services.segments.db [None req-ed5e5560-b4a2-4246-8738-7579a435d372 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1c3a289d-7f6e-4095-81e3-d89c2b08dba0') {} {{(pid=101245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:23:57.262269 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ed5e5560-b4a2-4246-8738-7579a435d372 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792877333818', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5113626'] for segment, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:57.276159 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ed5e5560-b4a2-4246-8738-7579a435d372 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:57.283011 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ed5e5560-b4a2-4246-8738-7579a435d372 admin admin] Releasing vlan 175 on physical network physnet1 to pool {{(pid=101245) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 16:23:57.283351 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ed5e5560-b4a2-4246-8738-7579a435d372 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7464060'] for segment, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: Traceback (most recent call last): Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: timer() Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: cb(*args, **kw) Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: return func(*args, **kwargs) Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: self._notify() Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: self.callback(batched_events) Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: event.method(event) Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: return f(self, *a, **k) Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: return self._get(url).json() Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: return self.request(url, 'GET', **kwargs) Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 16:23:57.284996 dv-cinder-816187-2-iscsi neutron-server[101245]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 16:23:57.349387 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ed5e5560-b4a2-4246-8738-7579a435d372 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-868772', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-2032313'] for network, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:57.371647 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ed5e5560-b4a2-4246-8738-7579a435d372 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:57.373861 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-ed5e5560-b4a2-4246-8738-7579a435d372 admin admin] 10.222.0.37 "DELETE /v2.0/networks/840ec990-538f-47e9-ab6a-3f378aa5803e HTTP/1.1" status: 204 len: 168 time: 0.5939724 Nov 08 16:23:57.374832 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed5e5560-b4a2-4246-8738-7579a435d372 admin admin] Pushing event deleted for resources: {'Network': ['ID=840ec990-538f-47e9-ab6a-3f378aa5803e,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:57.488221 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 43406) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:57.527738 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-16d2b455-103a-46ad-a5a0-8dcbd41dc602 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=343d5ca096394f87bea0950aa3811a13&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0382783 Nov 08 16:23:57.530425 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 43408) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:57.580898 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-13521a88-d621-40bb-9e05-632c0059434a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:57.601080 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-13521a88-d621-40bb-9e05-632c0059434a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:57.647030 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-13521a88-d621-40bb-9e05-632c0059434a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:57.649658 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-13521a88-d621-40bb-9e05-632c0059434a admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:57.650819 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-13521a88-d621-40bb-9e05-632c0059434a admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/560ce407-0e9f-4321-bc80-d89a35a1affe HTTP/1.1" status: 204 len: 168 time: 0.1195128 Nov 08 16:23:57.660888 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13521a88-d621-40bb-9e05-632c0059434a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=560ce407-0e9f-4321-bc80-d89a35a1affe,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:23:57.897523 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8 no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:23:57.924326 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: 8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:23:57.924638 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 8ea89676-21a4-4d8c-8eb7-bf83cf84f9c8 not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:23:57.925212 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device f275a781-b489-47a1-9715-eeec487362a2 no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:23:57.945925 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: f275a781-b489-47a1-9715-eeec487362a2 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:23:57.946271 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device f275a781-b489-47a1-9715-eeec487362a2 not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:23:57.946680 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 80170e07-aa47-42c5-8b3a-7eaefdd07f69 no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:23:57.965784 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: 80170e07-aa47-42c5-8b3a-7eaefdd07f69 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:23:57.966123 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 80170e07-aa47-42c5-8b3a-7eaefdd07f69 not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:23:57.993279 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 43424) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:58.034352 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-9d49f31b-74b2-46f2-ae50-178b4142139a admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=b8c79a72977c4451b0c2fb13bbce6425&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0398626 Nov 08 16:23:58.036843 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 43426) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:23:58.083752 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-255ddc14-87ae-436f-8805-771e9d9c7ce6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:58.106378 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-255ddc14-87ae-436f-8805-771e9d9c7ce6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:58.154236 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-255ddc14-87ae-436f-8805-771e9d9c7ce6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:58.157210 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-255ddc14-87ae-436f-8805-771e9d9c7ce6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:23:58.158411 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-255ddc14-87ae-436f-8805-771e9d9c7ce6 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/1177fc66-b2a1-4b4e-825a-9c747c789357 HTTP/1.1" status: 204 len: 168 time: 0.1206899 Nov 08 16:23:58.166303 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-255ddc14-87ae-436f-8805-771e9d9c7ce6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1177fc66-b2a1-4b4e-825a-9c747c789357,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:24:01.596563 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 43484) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:24:01.698880 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d2d46f6e-4333-49b3-80b2-988b6a2e8bd5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:01.769990 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d2d46f6e-4333-49b3-80b2-988b6a2e8bd5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:01.773634 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d2d46f6e-4333-49b3-80b2-988b6a2e8bd5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:01.810930 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-d2d46f6e-4333-49b3-80b2-988b6a2e8bd5 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=3ce711c133874e8ba93e122b8b04980f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2133281 Nov 08 16:24:01.811762 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2d46f6e-4333-49b3-80b2-988b6a2e8bd5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f5212df5-a215-4a88-9be2-e74378363944,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:24:01.813659 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43488) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:24:01.861831 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ce691214-378f-4376-890a-0e7429490424 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:01.882580 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ce691214-378f-4376-890a-0e7429490424 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:01.926594 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ce691214-378f-4376-890a-0e7429490424 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:01.929526 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-ce691214-378f-4376-890a-0e7429490424 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:01.930889 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-ce691214-378f-4376-890a-0e7429490424 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/f5212df5-a215-4a88-9be2-e74378363944 HTTP/1.1" status: 204 len: 168 time: 0.1147380 Nov 08 16:24:01.939125 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce691214-378f-4376-890a-0e7429490424 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f5212df5-a215-4a88-9be2-e74378363944,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:24:02.183459 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43494) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:24:02.199165 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-89402c14-8bc8-4850-b46a-72c3cde21e51 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:02.273821 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-89402c14-8bc8-4850-b46a-72c3cde21e51 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:02.277585 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-89402c14-8bc8-4850-b46a-72c3cde21e51 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:02.312232 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89402c14-8bc8-4850-b46a-72c3cde21e51 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d6859056-2501-4490-95b3-799a88399f91,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:24:02.316912 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-89402c14-8bc8-4850-b46a-72c3cde21e51 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=d7cec9d44cd3467787085b7d4496452e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1324453 Nov 08 16:24:02.319517 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43496) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:24:02.364441 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3532d0ce-a847-4be6-ab49-4fae416a7b49 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:02.385092 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3532d0ce-a847-4be6-ab49-4fae416a7b49 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:02.429681 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3532d0ce-a847-4be6-ab49-4fae416a7b49 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:02.432151 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3532d0ce-a847-4be6-ab49-4fae416a7b49 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:02.433283 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-3532d0ce-a847-4be6-ab49-4fae416a7b49 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/d6859056-2501-4490-95b3-799a88399f91 HTTP/1.1" status: 204 len: 168 time: 0.1128731 Nov 08 16:24:02.440872 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3532d0ce-a847-4be6-ab49-4fae416a7b49 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d6859056-2501-4490-95b3-799a88399f91,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:24:02.739858 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43502) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:24:02.752737 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b19615e4-dd97-4e73-b5ad-9b594f5574d4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:02.824988 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b19615e4-dd97-4e73-b5ad-9b594f5574d4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:02.829226 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b19615e4-dd97-4e73-b5ad-9b594f5574d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:02.865463 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-b19615e4-dd97-4e73-b5ad-9b594f5574d4 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=dbee2821210f4c88beec357d31e52bc2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1245666 Nov 08 16:24:02.866292 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b19615e4-dd97-4e73-b5ad-9b594f5574d4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=72c9c96a-6b76-4c6c-868b-369e7554ccbf,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:24:02.868165 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 43504) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:24:02.915901 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-79593de5-c809-4770-9707-1aac50e2f57d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:02.936395 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-79593de5-c809-4770-9707-1aac50e2f57d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:02.980056 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-79593de5-c809-4770-9707-1aac50e2f57d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:02.983970 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-79593de5-c809-4770-9707-1aac50e2f57d admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:02.985171 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-79593de5-c809-4770-9707-1aac50e2f57d admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/72c9c96a-6b76-4c6c-868b-369e7554ccbf HTTP/1.1" status: 204 len: 168 time: 0.1160157 Nov 08 16:24:02.992694 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79593de5-c809-4770-9707-1aac50e2f57d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=72c9c96a-6b76-4c6c-868b-369e7554ccbf,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:24:08.139959 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-a58ef362-5bf1-4efe-bed7-fb24279c3568 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:10.605854 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-16941b8b-fc68-4be8-a759-1b9aa3e44f34 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:11.569749 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:12.217422 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 43590) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:24:12.318317 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-540c4a9b-c97c-4b40-b59c-e18bbabc99cf admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:12.392954 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-540c4a9b-c97c-4b40-b59c-e18bbabc99cf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:12.396661 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-540c4a9b-c97c-4b40-b59c-e18bbabc99cf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:12.434125 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-540c4a9b-c97c-4b40-b59c-e18bbabc99cf admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=4626fd175f064aa1a7345522edab82d8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2155440 Nov 08 16:24:12.435015 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-540c4a9b-c97c-4b40-b59c-e18bbabc99cf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b42008be-0e84-40e3-b47e-e861b99ea736,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:24:12.438698 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43594) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:24:12.486407 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3d1291de-76e4-4890-8ac6-c74896731be3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:12.507416 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3d1291de-76e4-4890-8ac6-c74896731be3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:12.550788 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3d1291de-76e4-4890-8ac6-c74896731be3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:12.553306 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-3d1291de-76e4-4890-8ac6-c74896731be3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:12.557135 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-3d1291de-76e4-4890-8ac6-c74896731be3 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/b42008be-0e84-40e3-b47e-e861b99ea736 HTTP/1.1" status: 204 len: 168 time: 0.1173759 Nov 08 16:24:12.565245 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d1291de-76e4-4890-8ac6-c74896731be3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b42008be-0e84-40e3-b47e-e861b99ea736,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:24:13.301439 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:13.972211 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:15.596292 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:24:19.758665 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:20.229263 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43712) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:24:20.331101 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a4c20fc6-b52a-4ae4-953e-e448477cdab6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:20.404550 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a4c20fc6-b52a-4ae4-953e-e448477cdab6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:20.408039 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-a4c20fc6-b52a-4ae4-953e-e448477cdab6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:20.449498 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4c20fc6-b52a-4ae4-953e-e448477cdab6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=144ad4db-3c75-4bb9-bd8c-3d9eef08b455,revision_number=1']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:24:20.458050 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-a4c20fc6-b52a-4ae4-953e-e448477cdab6 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=b1878e5d7134480c8f9b358432dd5bc6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2252283 Nov 08 16:24:20.458577 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43716) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:24:20.503629 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b88054ec-bddd-4547-bd3d-3035898061f3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:20.523236 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b88054ec-bddd-4547-bd3d-3035898061f3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:20.567437 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b88054ec-bddd-4547-bd3d-3035898061f3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:20.570071 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-b88054ec-bddd-4547-bd3d-3035898061f3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:20.571152 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-b88054ec-bddd-4547-bd3d-3035898061f3 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/144ad4db-3c75-4bb9-bd8c-3d9eef08b455 HTTP/1.1" status: 204 len: 168 time: 0.1120045 Nov 08 16:24:20.578687 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b88054ec-bddd-4547-bd3d-3035898061f3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=144ad4db-3c75-4bb9-bd8c-3d9eef08b455,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:24:20.816276 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 43722) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:24:20.829656 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d900f958-b7ae-4f2c-a5af-3d0c09aeb5b7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:20.902514 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d900f958-b7ae-4f2c-a5af-3d0c09aeb5b7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:20.906088 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-d900f958-b7ae-4f2c-a5af-3d0c09aeb5b7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:20.942971 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-d900f958-b7ae-4f2c-a5af-3d0c09aeb5b7 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=6681110bebb54a9eb715f7f540b4ec1f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1255965 Nov 08 16:24:20.943774 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d900f958-b7ae-4f2c-a5af-3d0c09aeb5b7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ca71d54a-4008-4887-b76a-545846ec7ee2,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:24:20.945682 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43724) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:24:20.992979 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-8ac0609b-1bd1-452b-8deb-4f4699d570ca admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:21.013531 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-8ac0609b-1bd1-452b-8deb-4f4699d570ca admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:21.058495 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-8ac0609b-1bd1-452b-8deb-4f4699d570ca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:21.061005 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-8ac0609b-1bd1-452b-8deb-4f4699d570ca admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:21.062166 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-8ac0609b-1bd1-452b-8deb-4f4699d570ca admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/ca71d54a-4008-4887-b76a-545846ec7ee2 HTTP/1.1" status: 204 len: 168 time: 0.1154065 Nov 08 16:24:21.069905 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ac0609b-1bd1-452b-8deb-4f4699d570ca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ca71d54a-4008-4887-b76a-545846ec7ee2,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:24:21.368447 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 43730) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:24:21.382365 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-1e1c7b9a-e6ca-4ec2-ab64-490c0a4cb869 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:21.451911 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-1e1c7b9a-e6ca-4ec2-ab64-490c0a4cb869 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:21.455608 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-1e1c7b9a-e6ca-4ec2-ab64-490c0a4cb869 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:21.496175 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-1e1c7b9a-e6ca-4ec2-ab64-490c0a4cb869 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=c6256a204c764875b89aa9e3e866fde3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1266532 Nov 08 16:24:21.497039 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e1c7b9a-e6ca-4ec2-ab64-490c0a4cb869 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=58fe39cd-6c21-488a-8bec-77088facb3dc,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:24:21.499627 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 43732) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:24:21.549513 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0e9d072c-9fb5-4b7e-a77c-309d32ebca2a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:21.569367 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0e9d072c-9fb5-4b7e-a77c-309d32ebca2a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:21.614246 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0e9d072c-9fb5-4b7e-a77c-309d32ebca2a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:21.616835 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-0e9d072c-9fb5-4b7e-a77c-309d32ebca2a admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:21.617954 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-0e9d072c-9fb5-4b7e-a77c-309d32ebca2a admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/58fe39cd-6c21-488a-8bec-77088facb3dc HTTP/1.1" status: 204 len: 168 time: 0.1158133 Nov 08 16:24:21.626610 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e9d072c-9fb5-4b7e-a77c-309d32ebca2a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=58fe39cd-6c21-488a-8bec-77088facb3dc,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:24:23.271717 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-63ca99b1-6bca-43da-a675-49e057292a73 req-56fd9df4-f112-46f5-b1c2-f86784d736fc service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0383477 Nov 08 16:24:23.351729 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ca99b1-6bca-43da-a675-49e057292a73 req-28b54466-9389-433d-a942-7605aa9f4715 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:23.353074 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-63ca99b1-6bca-43da-a675-49e057292a73 req-28b54466-9389-433d-a942-7605aa9f4715 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=71b067e1fbac491a8e16a4ba91049db9&device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 1099 time: 0.0383918 Nov 08 16:24:23.456353 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ca99b1-6bca-43da-a675-49e057292a73 req-3ea60121-ac94-41ae-95e1-e3f765c39d89 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:23.457835 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-63ca99b1-6bca-43da-a675-49e057292a73 req-3ea60121-ac94-41ae-95e1-e3f765c39d89 service neutron] 10.222.0.25 "GET /v2.0/networks?id=f9b0f22e-a782-44ad-bfe0-8de1f795305e HTTP/1.1" status: 200 len: 910 time: 0.0850112 Nov 08 16:24:23.521575 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-63ca99b1-6bca-43da-a675-49e057292a73 req-1b59b725-4a5e-4c54-b347-a6a80bc7c9d6 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=e8c812be-3317-46f0-9044-f415824262be HTTP/1.1" status: 200 len: 1002 time: 0.0559268 Nov 08 16:24:23.567854 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ca99b1-6bca-43da-a675-49e057292a73 req-1248887d-e7af-4fc1-b57d-a468078afb23 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:23.569218 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-63ca99b1-6bca-43da-a675-49e057292a73 req-1248887d-e7af-4fc1-b57d-a468078afb23 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=67fc8ce5-82b1-4d6d-bf54-e59b246e08c9 HTTP/1.1" status: 200 len: 848 time: 0.0409644 Nov 08 16:24:23.616558 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ca99b1-6bca-43da-a675-49e057292a73 req-9904827e-b230-496c-9b31-3c56f3e6bf68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:23.617950 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-63ca99b1-6bca-43da-a675-49e057292a73 req-9904827e-b230-496c-9b31-3c56f3e6bf68 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=f9b0f22e-a782-44ad-bfe0-8de1f795305e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0417547 Nov 08 16:24:23.705265 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-63ca99b1-6bca-43da-a675-49e057292a73 req-420af2f9-6e38-4bf1-9261-eb39e72e906e service neutron] 10.222.0.25 "GET /v2.0/networks/f9b0f22e-a782-44ad-bfe0-8de1f795305e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0802088 Nov 08 16:24:23.813870 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-bfe947f9-a815-4bfb-97bf-d7d5cbcc0140 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/networks?tenant_id=ad26288dfab54e44b0ef67b8ee1277bf&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0367022 Nov 08 16:24:23.860480 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-63ca99b1-6bca-43da-a675-49e057292a73 req-9748d293-4bb3-48ce-a56e-7366b7514285 service neutron] 10.222.0.25 "GET /v2.0/networks/f9b0f22e-a782-44ad-bfe0-8de1f795305e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1447906 Nov 08 16:24:24.001626 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-a040369a-4b95-407b-ab51-eb644fa9a6fd tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:24.003123 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-a040369a-4b95-407b-ab51-eb644fa9a6fd tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1835690 Nov 08 16:24:24.018039 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-804f8fc2-47c0-4ee9-933e-dd2e22a3e6ea tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/quotas/ad26288dfab54e44b0ef67b8ee1277bf HTTP/1.1" status: 200 len: 375 time: 0.0093198 Nov 08 16:24:24.052494 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-2cdca7b0-364d-4050-9374-f99690f1c1de tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/ports?tenant_id=ad26288dfab54e44b0ef67b8ee1277bf&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0293620 Nov 08 16:24:24.443469 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-41de6174-16d2-4542-b1dd-54557c3ad45d req-79e25415-b947-4834-984c-285bab15b8ca tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/ports?device_id=184e206e-40e2-43b8-bcd2-e7da4021a70f HTTP/1.1" status: 200 len: 210 time: 0.2601037 Nov 08 16:24:25.518211 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-26fd5c82-1a94-42e1-a193-e7a814d36f7b req-f8d03900-c9fa-418e-a5f5-9c9c48fabd3c tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/ports?device_id=184e206e-40e2-43b8-bcd2-e7da4021a70f HTTP/1.1" status: 200 len: 210 time: 0.0252254 Nov 08 16:24:26.591516 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4534eb94-8111-4a85-ac38-2f1fa0471cc3 req-91161ac5-c181-435e-ba86-2896b87f9249 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/ports?device_id=184e206e-40e2-43b8-bcd2-e7da4021a70f HTTP/1.1" status: 200 len: 210 time: 0.0245900 Nov 08 16:24:27.682546 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6d1187ed-7c60-478f-b5d0-3239e3a337f7 req-06702f0f-6b29-4bb9-b492-8ec8b3ed6eff tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/ports?device_id=184e206e-40e2-43b8-bcd2-e7da4021a70f HTTP/1.1" status: 200 len: 210 time: 0.0262671 Nov 08 16:24:28.777377 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6029c0f3-cac1-41c4-ab81-e86bd6246734 req-2393ae9c-2cea-4813-9240-91194c579f21 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/ports?device_id=184e206e-40e2-43b8-bcd2-e7da4021a70f HTTP/1.1" status: 200 len: 210 time: 0.0288172 Nov 08 16:24:29.443731 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-22d4dd17-63a2-449d-b52d-cfcd40b3612f tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.25 "GET /v2.0/networks?tenant_id=ad26288dfab54e44b0ef67b8ee1277bf&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0212653 Nov 08 16:24:29.549676 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-5708121d-b785-4929-9058-88277a4e4899 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:29.551184 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-5708121d-b785-4929-9058-88277a4e4899 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1019447 Nov 08 16:24:29.568432 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-79a22610-a08b-444f-8470-30d64b5371ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Request body: {'port': {'device_id': '184e206e-40e2-43b8-bcd2-e7da4021a70f', 'network_id': 'a2294cb7-764a-4e2f-b2f9-20c7c9294f57', 'admin_state_up': True, 'tenant_id': 'ad26288dfab54e44b0ef67b8ee1277bf'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:24:29.675839 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-79a22610-a08b-444f-8470-30d64b5371ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Made reservation on behalf of ad26288dfab54e44b0ef67b8ee1277bf for: {'port': 1} {{(pid=101244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 16:24:29.679297 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-79a22610-a08b-444f-8470-30d64b5371ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:29.688587 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-79a22610-a08b-444f-8470-30d64b5371ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Publish callbacks [] for security_group, before_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:29.759923 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-79a22610-a08b-444f-8470-30d64b5371ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Publish callbacks [] for security_group, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:29.764657 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-79a22610-a08b-444f-8470-30d64b5371ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:29.837410 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79a22610-a08b-444f-8470-30d64b5371ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3a7a3dd0-8ace-462c-a701-044684af898b,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:24:29.889130 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8f95ae10-3026-48d3-9000-fbe869162e01 req-e949e351-823c-4985-aeff-9a6e7aa0da67 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/ports?device_id=184e206e-40e2-43b8-bcd2-e7da4021a70f HTTP/1.1" status: 200 len: 210 time: 0.0368187 Nov 08 16:24:29.939699 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.db_base_plugin_common [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-79a22610-a08b-444f-8470-30d64b5371ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Allocated IP 192.168.233.110 (a2294cb7-764a-4e2f-b2f9-20c7c9294f57/4b4a67eb-b83b-4b1a-85f3-128683340457/253b06d3-fdef-4152-8be6-3b6d31dc4c2a) {{(pid=101244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 16:24:30.083290 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-79a22610-a08b-444f-8470-30d64b5371ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Publish callbacks [] for port, precommit_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:30.115952 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-79a22610-a08b-444f-8470-30d64b5371ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792876777355', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_create {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:30.156685 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-79a22610-a08b-444f-8470-30d64b5371ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Network a2294cb7-764a-4e2f-b2f9-20c7c9294f57 is already hosted by enough agents. {{(pid=101244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 16:24:30.159871 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.base_scheduler [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-79a22610-a08b-444f-8470-30d64b5371ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Resources bound (agent type, host, resource id): {{(pid=101244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 16:24:30.166067 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-79a22610-a08b-444f-8470-30d64b5371ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Received port after_create {{(pid=101244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 16:24:30.195693 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79a22610-a08b-444f-8470-30d64b5371ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Pushing event updated for resources: {'Port': ['ID=253b06d3-fdef-4152-8be6-3b6d31dc4c2a,revision_number=1']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:24:30.221404 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-79a22610-a08b-444f-8470-30d64b5371ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:30.222235 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-79a22610-a08b-444f-8470-30d64b5371ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:30.244595 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-79a22610-a08b-444f-8470-30d64b5371ec tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 0.6796637 Nov 08 16:24:30.256859 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.v2.base [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-db07c942-90ae-43be-852b-ed5505ff3e7a service neutron] Request body: {'port': {'device_id': '184e206e-40e2-43b8-bcd2-e7da4021a70f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81618'}} {{(pid=101244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 16:24:30.315708 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-db07c942-90ae-43be-852b-ed5505ff3e7a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:30.427658 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-f2d5db85-e0be-4db4-b350-8b6b0ca66a80 None None] Provisioning complete for port 253b06d3-fdef-4152-8be6-3b6d31dc4c2a triggered by entity DHCP. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:24:30.428232 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-f2d5db85-e0be-4db4-b350-8b6b0ca66a80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:30.460545 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-f2d5db85-e0be-4db4-b350-8b6b0ca66a80 None None] Port 253b06d3-fdef-4152-8be6-3b6d31dc4c2a cannot update to ACTIVE because it is not bound. {{(pid=101246) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 16:24:30.567901 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-db07c942-90ae-43be-852b-ed5505ff3e7a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 253b06d3-fdef-4152-8be6-3b6d31dc4c2a {{(pid=101244) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:24:30.574999 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-db07c942-90ae-43be-852b-ed5505ff3e7a service neutron] Publish callbacks [] for port, precommit_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:30.587038 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.provisioning_blocks [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-db07c942-90ae-43be-852b-ed5505ff3e7a service neutron] Transition to ACTIVE for port object 253b06d3-fdef-4152-8be6-3b6d31dc4c2a will not be triggered until provisioned by entity L2. {{(pid=101244) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 16:24:30.590437 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-db07c942-90ae-43be-852b-ed5505ff3e7a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:30.639234 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db07c942-90ae-43be-852b-ed5505ff3e7a service neutron] Pushing event updated for resources: {'Port': ['ID=253b06d3-fdef-4152-8be6-3b6d31dc4c2a,revision_number=2']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:24:30.710434 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-db07c942-90ae-43be-852b-ed5505ff3e7a service neutron] Attempting to bind port 253b06d3-fdef-4152-8be6-3b6d31dc4c2a on host hv-cinder-81618 for vnic_type normal with profile {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 16:24:30.710763 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-db07c942-90ae-43be-852b-ed5505ff3e7a service neutron] Attempting to bind port 253b06d3-fdef-4152-8be6-3b6d31dc4c2a by drivers openvswitch,hyperv on host hv-cinder-81618 at level 0 using segments [{'id': '51e384ca-3902-4a51-92bb-10c10d81cc09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': 'a2294cb7-764a-4e2f-b2f9-20c7c9294f57'}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 16:24:30.711089 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-db07c942-90ae-43be-852b-ed5505ff3e7a service neutron] Attempting to bind port 253b06d3-fdef-4152-8be6-3b6d31dc4c2a on network a2294cb7-764a-4e2f-b2f9-20c7c9294f57 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:24:30.715608 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-db07c942-90ae-43be-852b-ed5505ff3e7a service neutron] Port 253b06d3-fdef-4152-8be6-3b6d31dc4c2a on network a2294cb7-764a-4e2f-b2f9-20c7c9294f57 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81618 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 16:24:30.716045 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-db07c942-90ae-43be-852b-ed5505ff3e7a service neutron] Attempting to bind port 253b06d3-fdef-4152-8be6-3b6d31dc4c2a on network a2294cb7-764a-4e2f-b2f9-20c7c9294f57 {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 16:24:30.721674 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-db07c942-90ae-43be-852b-ed5505ff3e7a service neutron] Checking agent: {'id': '54bf9779-c14d-412a-90fc-96b4a6589d5a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81618', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'started_at': datetime.datetime(2021, 11, 8, 16, 9, 16), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 16, 24, 20), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 16:24:30.722035 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-db07c942-90ae-43be-852b-ed5505ff3e7a service neutron] Checking segment: {'id': '51e384ca-3902-4a51-92bb-10c10d81cc09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': 'a2294cb7-764a-4e2f-b2f9-20c7c9294f57'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 16:24:30.722418 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-db07c942-90ae-43be-852b-ed5505ff3e7a service neutron] Bound using segment: {'id': '51e384ca-3902-4a51-92bb-10c10d81cc09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': 'a2294cb7-764a-4e2f-b2f9-20c7c9294f57'} {{(pid=101244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 16:24:30.722857 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.managers [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-db07c942-90ae-43be-852b-ed5505ff3e7a service neutron] Bound port: 253b06d3-fdef-4152-8be6-3b6d31dc4c2a, host: hv-cinder-81618, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '51e384ca-3902-4a51-92bb-10c10d81cc09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': 'a2294cb7-764a-4e2f-b2f9-20c7c9294f57'}}] {{(pid=101244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 16:24:30.723194 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-db07c942-90ae-43be-852b-ed5505ff3e7a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:30.786748 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-db07c942-90ae-43be-852b-ed5505ff3e7a service neutron] For port 253b06d3-fdef-4152-8be6-3b6d31dc4c2a, host hv-cinder-81618, cleared binding levels {{(pid=101244) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 16:24:30.789676 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-db07c942-90ae-43be-852b-ed5505ff3e7a service neutron] For port 253b06d3-fdef-4152-8be6-3b6d31dc4c2a, host hv-cinder-81618, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=253b06d3-fdef-4152-8be6-3b6d31dc4c2a,segment=NetworkSegment(51e384ca-3902-4a51-92bb-10c10d81cc09),segment_id=51e384ca-3902-4a51-92bb-10c10d81cc09)] {{(pid=101244) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 16:24:30.794227 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-db07c942-90ae-43be-852b-ed5505ff3e7a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4227584'] for port, after_update {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:30.825914 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-db07c942-90ae-43be-852b-ed5505ff3e7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:30.826537 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-db07c942-90ae-43be-852b-ed5505ff3e7a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:30.827920 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-db07c942-90ae-43be-852b-ed5505ff3e7a service neutron] 10.222.0.25 "PUT /v2.0/ports/253b06d3-fdef-4152-8be6-3b6d31dc4c2a HTTP/1.1" status: 200 len: 1098 time: 0.5752318 Nov 08 16:24:30.828354 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '184e206e-40e2-43b8-bcd2-e7da4021a70f', 'tag': '253b06d3-fdef-4152-8be6-3b6d31dc4c2a'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:24:30.830611 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bc61d35c-d1da-4cf7-8c1a-f1baacda537d" -d '{"events": [{"name": "network-changed", "server_uuid": "184e206e-40e2-43b8-bcd2-e7da4021a70f", "tag": "253b06d3-fdef-4152-8be6-3b6d31dc4c2a"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:24:30.856272 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db07c942-90ae-43be-852b-ed5505ff3e7a service neutron] Pushing event updated for resources: {'Port': ['ID=253b06d3-fdef-4152-8be6-3b6d31dc4c2a,revision_number=3']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:24:30.890707 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:24:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eb206bc0-34fe-443d-8561-95f9ecae6386 x-openstack-request-id: req-eb206bc0-34fe-443d-8561-95f9ecae6386 {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:24:30.890996 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "184e206e-40e2-43b8-bcd2-e7da4021a70f", "tag": "253b06d3-fdef-4152-8be6-3b6d31dc4c2a", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:24:30.891253 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-eb206bc0-34fe-443d-8561-95f9ecae6386 {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:24:30.891642 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '184e206e-40e2-43b8-bcd2-e7da4021a70f', 'tag': '253b06d3-fdef-4152-8be6-3b6d31dc4c2a', 'status': 'completed', 'code': 200} Nov 08 16:24:30.932028 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-7f4dfd6c-720d-49d8-bb8f-15750c698db9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:30.933657 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-7f4dfd6c-720d-49d8-bb8f-15750c698db9 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=ad26288dfab54e44b0ef67b8ee1277bf&device_id=184e206e-40e2-43b8-bcd2-e7da4021a70f HTTP/1.1" status: 200 len: 1101 time: 0.0544872 Nov 08 16:24:30.989102 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-c1f4a460-e954-45d7-937e-d77bdfce743f service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.110&port_id=253b06d3-fdef-4152-8be6-3b6d31dc4c2a HTTP/1.1" status: 200 len: 217 time: 0.0455420 Nov 08 16:24:31.060915 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-9235c7b8-b668-40e0-962b-74dcc264bda0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:31.062928 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-9235c7b8-b668-40e0-962b-74dcc264bda0 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=4b4a67eb-b83b-4b1a-85f3-128683340457 HTTP/1.1" status: 200 len: 843 time: 0.0551381 Nov 08 16:24:31.070453 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a227d82d-eeb8-4e38-a897-6e57ae61dd9d req-e17dafd9-f4e0-4f68-bf99-79c78e81ad98 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:31.071820 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a227d82d-eeb8-4e38-a897-6e57ae61dd9d req-e17dafd9-f4e0-4f68-bf99-79c78e81ad98 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/ports?device_id=184e206e-40e2-43b8-bcd2-e7da4021a70f HTTP/1.1" status: 200 len: 948 time: 0.0921397 Nov 08 16:24:31.139792 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-698e3e46-4638-4f69-b00e-7aa0e89c0c65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:31.141396 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-698e3e46-4638-4f69-b00e-7aa0e89c0c65 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=a2294cb7-764a-4e2f-b2f9-20c7c9294f57&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0687170 Nov 08 16:24:31.144998 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a227d82d-eeb8-4e38-a897-6e57ae61dd9d req-4682bc26-3b77-4cf1-a3ee-f3fa2182812d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/security-groups?id=3a7a3dd0-8ace-462c-a701-044684af898b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0652485 Nov 08 16:24:31.231814 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-c7e701aa-a46e-425a-af90-1ea992da5724 service neutron] 10.222.0.25 "GET /v2.0/networks/a2294cb7-764a-4e2f-b2f9-20c7c9294f57?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0828702 Nov 08 16:24:31.319826 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-69c20c96-47b5-4a91-ae02-2baf275c278d req-9af5d331-51ea-4099-8a63-73bc149c3b1a service neutron] 10.222.0.25 "GET /v2.0/networks/a2294cb7-764a-4e2f-b2f9-20c7c9294f57?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0800686 Nov 08 16:24:31.399653 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc61d35c-d1da-4cf7-8c1a-f1baacda537d req-46db010f-a71b-408c-9435-59c6d95066fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:31.401112 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bc61d35c-d1da-4cf7-8c1a-f1baacda537d req-46db010f-a71b-408c-9435-59c6d95066fc service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=ad26288dfab54e44b0ef67b8ee1277bf&device_id=184e206e-40e2-43b8-bcd2-e7da4021a70f HTTP/1.1" status: 200 len: 1101 time: 0.0394268 Nov 08 16:24:31.494621 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc61d35c-d1da-4cf7-8c1a-f1baacda537d req-056555d0-9129-4dbe-819e-44ac889a1908 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:31.496240 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bc61d35c-d1da-4cf7-8c1a-f1baacda537d req-056555d0-9129-4dbe-819e-44ac889a1908 service neutron] 10.222.0.25 "GET /v2.0/networks?id=a2294cb7-764a-4e2f-b2f9-20c7c9294f57 HTTP/1.1" status: 200 len: 870 time: 0.0873477 Nov 08 16:24:31.536289 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bc61d35c-d1da-4cf7-8c1a-f1baacda537d req-5f21fb6a-23cd-4e2f-a92a-8c7a3bf2386e service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.110&port_id=253b06d3-fdef-4152-8be6-3b6d31dc4c2a HTTP/1.1" status: 200 len: 217 time: 0.0332029 Nov 08 16:24:31.584288 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc61d35c-d1da-4cf7-8c1a-f1baacda537d req-8e64ffdc-d20d-4568-8e24-a19bd446271e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:31.585684 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bc61d35c-d1da-4cf7-8c1a-f1baacda537d req-8e64ffdc-d20d-4568-8e24-a19bd446271e service neutron] 10.222.0.25 "GET /v2.0/subnets?id=4b4a67eb-b83b-4b1a-85f3-128683340457 HTTP/1.1" status: 200 len: 843 time: 0.0425522 Nov 08 16:24:31.633055 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc61d35c-d1da-4cf7-8c1a-f1baacda537d req-faf5edba-189a-4cd3-98e0-7cb8f5859881 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:31.634553 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bc61d35c-d1da-4cf7-8c1a-f1baacda537d req-faf5edba-189a-4cd3-98e0-7cb8f5859881 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=a2294cb7-764a-4e2f-b2f9-20c7c9294f57&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0414591 Nov 08 16:24:31.720780 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bc61d35c-d1da-4cf7-8c1a-f1baacda537d req-b82d4dce-230a-4046-bdaa-b2796243e86e service neutron] 10.222.0.25 "GET /v2.0/networks/a2294cb7-764a-4e2f-b2f9-20c7c9294f57?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0787706 Nov 08 16:24:31.813175 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bc61d35c-d1da-4cf7-8c1a-f1baacda537d req-dc9e87cc-1aec-4b0c-8f4b-98ec1a957d40 service neutron] 10.222.0.25 "GET /v2.0/networks/a2294cb7-764a-4e2f-b2f9-20c7c9294f57?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0840759 Nov 08 16:24:32.263417 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01a39449-4749-4754-ba0e-7c2a5aa29505 req-4b997ad1-13cb-40bb-89f8-27214c1f9c64 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:32.264867 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-01a39449-4749-4754-ba0e-7c2a5aa29505 req-4b997ad1-13cb-40bb-89f8-27214c1f9c64 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/ports?device_id=184e206e-40e2-43b8-bcd2-e7da4021a70f HTTP/1.1" status: 200 len: 948 time: 0.0530915 Nov 08 16:24:32.311097 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-01a39449-4749-4754-ba0e-7c2a5aa29505 req-87bc098d-7dce-4010-914b-2c10281214d5 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/security-groups?id=3a7a3dd0-8ace-462c-a701-044684af898b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402875 Nov 08 16:24:33.422340 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a76ac33-c05a-477c-b3eb-1aef192a1814 req-b462eef1-81c9-44e2-baa7-85894009fd1d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:33.423767 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3a76ac33-c05a-477c-b3eb-1aef192a1814 req-b462eef1-81c9-44e2-baa7-85894009fd1d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/ports?device_id=184e206e-40e2-43b8-bcd2-e7da4021a70f HTTP/1.1" status: 200 len: 948 time: 0.0470028 Nov 08 16:24:33.472058 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-3a76ac33-c05a-477c-b3eb-1aef192a1814 req-64a6aa58-3005-41de-94a0-56ff34346efb tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/security-groups?id=3a7a3dd0-8ace-462c-a701-044684af898b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425439 Nov 08 16:24:34.120647 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 253b06d3-fdef-4152-8be6-3b6d31dc4c2a details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:24:34.212419 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 253b06d3-fdef-4152-8be6-3b6d31dc4c2a, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=253b06d3-fdef-4152-8be6-3b6d31dc4c2a,segment=NetworkSegment(51e384ca-3902-4a51-92bb-10c10d81cc09),segment_id=51e384ca-3902-4a51-92bb-10c10d81cc09)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:24:34.223503 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': '253b06d3-fdef-4152-8be6-3b6d31dc4c2a', 'network_id': 'a2294cb7-764a-4e2f-b2f9-20c7c9294f57', 'port_id': '253b06d3-fdef-4152-8be6-3b6d31dc4c2a', 'mac_address': 'fa:16:3e:fe:8d:d6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 199, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4b4a67eb-b83b-4b1a-85f3-128683340457', 'ip_address': '192.168.233.110'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:24:34.259758 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:34.272143 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 253b06d3-fdef-4152-8be6-3b6d31dc4c2a {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:24:34.290977 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 253b06d3-fdef-4152-8be6-3b6d31dc4c2a, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=253b06d3-fdef-4152-8be6-3b6d31dc4c2a,segment=NetworkSegment(51e384ca-3902-4a51-92bb-10c10d81cc09),segment_id=51e384ca-3902-4a51-92bb-10c10d81cc09)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:24:34.294809 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:34.338976 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=253b06d3-fdef-4152-8be6-3b6d31dc4c2a,revision_number=4']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:24:34.585133 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e19f988c-bad0-40aa-85b5-ed87e07e73a0 req-b7dcf264-8570-4d22-8707-7becb40fd9fb tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:34.586612 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e19f988c-bad0-40aa-85b5-ed87e07e73a0 req-b7dcf264-8570-4d22-8707-7becb40fd9fb tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/ports?device_id=184e206e-40e2-43b8-bcd2-e7da4021a70f HTTP/1.1" status: 200 len: 949 time: 0.0491283 Nov 08 16:24:34.632728 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e19f988c-bad0-40aa-85b5-ed87e07e73a0 req-12449b1e-92aa-4639-a5e0-7805f2e38415 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/security-groups?id=3a7a3dd0-8ace-462c-a701-044684af898b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399914 Nov 08 16:24:34.674365 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['253b06d3-fdef-4152-8be6-3b6d31dc4c2a'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:24:35.744022 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5738cd74-1dd9-4bba-93af-05d658875d8b req-329cd6cc-9f11-4b2e-944f-e2628804ea7d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:35.745767 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5738cd74-1dd9-4bba-93af-05d658875d8b req-329cd6cc-9f11-4b2e-944f-e2628804ea7d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/ports?device_id=184e206e-40e2-43b8-bcd2-e7da4021a70f HTTP/1.1" status: 200 len: 949 time: 0.0475566 Nov 08 16:24:35.792752 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5738cd74-1dd9-4bba-93af-05d658875d8b req-a0852869-bd80-4799-be04-971e3a4dec1d tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/security-groups?id=3a7a3dd0-8ace-462c-a701-044684af898b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406392 Nov 08 16:24:36.136280 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 253b06d3-fdef-4152-8be6-3b6d31dc4c2a up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:24:36.183187 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning for port 253b06d3-fdef-4152-8be6-3b6d31dc4c2a completed by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 16:24:36.186965 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port 253b06d3-fdef-4152-8be6-3b6d31dc4c2a triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:24:36.187362 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:36.265067 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:36.292302 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '184e206e-40e2-43b8-bcd2-e7da4021a70f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '253b06d3-fdef-4152-8be6-3b6d31dc4c2a'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:24:36.294522 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4ec9672f-37be-4c5d-bf95-d6961f204dbd" -d '{"events": [{"server_uuid": "184e206e-40e2-43b8-bcd2-e7da4021a70f", "name": "network-vif-plugged", "status": "completed", "tag": "253b06d3-fdef-4152-8be6-3b6d31dc4c2a"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:24:36.307322 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port 253b06d3-fdef-4152-8be6-3b6d31dc4c2a, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=253b06d3-fdef-4152-8be6-3b6d31dc4c2a,segment=NetworkSegment(51e384ca-3902-4a51-92bb-10c10d81cc09),segment_id=51e384ca-3902-4a51-92bb-10c10d81cc09)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:24:36.312445 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:36.336054 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:24:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-99888f46-d045-40c1-ac74-49cddf76e22a x-openstack-request-id: req-99888f46-d045-40c1-ac74-49cddf76e22a {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:24:36.336281 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "184e206e-40e2-43b8-bcd2-e7da4021a70f", "name": "network-vif-plugged", "status": "completed", "tag": "253b06d3-fdef-4152-8be6-3b6d31dc4c2a", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:24:36.336532 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-99888f46-d045-40c1-ac74-49cddf76e22a {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:24:36.336913 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '184e206e-40e2-43b8-bcd2-e7da4021a70f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '253b06d3-fdef-4152-8be6-3b6d31dc4c2a', 'code': 200} Nov 08 16:24:36.363509 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=253b06d3-fdef-4152-8be6-3b6d31dc4c2a,revision_number=5']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:24:36.495621 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d918899d-6919-4daf-9ae1-e8a05b2e0292 req-66c509ff-ef1a-41f0-b852-0621aeb5be4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:36.497058 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d918899d-6919-4daf-9ae1-e8a05b2e0292 req-66c509ff-ef1a-41f0-b852-0621aeb5be4b service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=184e206e-40e2-43b8-bcd2-e7da4021a70f HTTP/1.1" status: 200 len: 1103 time: 0.0414293 Nov 08 16:24:36.540260 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d918899d-6919-4daf-9ae1-e8a05b2e0292 req-ce8f1436-37c1-4e2b-895e-161a77bee16c service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=3a7a3dd0-8ace-462c-a701-044684af898b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0360775 Nov 08 16:24:36.905361 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd529a24-9fbf-435e-9d2c-5fd6ffb0363b req-ec17d7f2-1d2b-46c0-8d0d-900f8fa0393a tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:36.906877 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cd529a24-9fbf-435e-9d2c-5fd6ffb0363b req-ec17d7f2-1d2b-46c0-8d0d-900f8fa0393a tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/ports?device_id=184e206e-40e2-43b8-bcd2-e7da4021a70f HTTP/1.1" status: 200 len: 950 time: 0.0484262 Nov 08 16:24:36.951871 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cd529a24-9fbf-435e-9d2c-5fd6ffb0363b req-7f183d81-8d0f-4c69-8e12-e3bc0327def1 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/security-groups?id=3a7a3dd0-8ace-462c-a701-044684af898b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391648 Nov 08 16:24:38.066893 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fce4c8ef-faa5-4b15-ac42-f8f269fcce56 req-996e94ea-531c-4669-ba4a-9fe3e3601140 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:38.068347 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fce4c8ef-faa5-4b15-ac42-f8f269fcce56 req-996e94ea-531c-4669-ba4a-9fe3e3601140 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/ports?device_id=184e206e-40e2-43b8-bcd2-e7da4021a70f HTTP/1.1" status: 200 len: 950 time: 0.0473790 Nov 08 16:24:38.116730 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fce4c8ef-faa5-4b15-ac42-f8f269fcce56 req-1f74d46a-f56c-41ab-be09-53df674ec6b5 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/security-groups?id=3a7a3dd0-8ace-462c-a701-044684af898b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425010 Nov 08 16:24:38.140746 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-c186d679-4b14-4e6a-8a44-11836b08574b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:38.363503 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0592efc1-0822-493a-979b-052aedbbe0e9 req-3d104872-a405-446e-8c81-515c47307714 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:38.364946 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0592efc1-0822-493a-979b-052aedbbe0e9 req-3d104872-a405-446e-8c81-515c47307714 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/ports?device_id=184e206e-40e2-43b8-bcd2-e7da4021a70f HTTP/1.1" status: 200 len: 950 time: 0.0474362 Nov 08 16:24:38.411180 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0592efc1-0822-493a-979b-052aedbbe0e9 req-adb2fce9-7304-42fb-bdfd-0dfa12e216aa tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/security-groups?id=3a7a3dd0-8ace-462c-a701-044684af898b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400367 Nov 08 16:24:39.527322 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52fbea11-c53f-42e6-a1b5-a2ee416519ec req-5788096e-f27c-4609-86c8-5a218c697d90 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:39.528790 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-52fbea11-c53f-42e6-a1b5-a2ee416519ec req-5788096e-f27c-4609-86c8-5a218c697d90 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/ports?device_id=184e206e-40e2-43b8-bcd2-e7da4021a70f HTTP/1.1" status: 200 len: 950 time: 0.0482554 Nov 08 16:24:39.574276 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-52fbea11-c53f-42e6-a1b5-a2ee416519ec req-3628fac0-ca71-477c-91ce-412246e45a85 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/security-groups?id=3a7a3dd0-8ace-462c-a701-044684af898b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389063 Nov 08 16:24:39.784144 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9ef8661-8cbb-4beb-9a26-4c4b4142d9cb req-c1412934-6bea-4b13-9ca8-c70986e07953 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:24:39.785615 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d9ef8661-8cbb-4beb-9a26-4c4b4142d9cb req-c1412934-6bea-4b13-9ca8-c70986e07953 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.25 "GET /v2.0/ports?device_id=184e206e-40e2-43b8-bcd2-e7da4021a70f HTTP/1.1" status: 200 len: 950 time: 0.0502024 Nov 08 16:24:39.869985 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-d9ef8661-8cbb-4beb-9a26-4c4b4142d9cb req-0200ba48-ff9c-48d3-88fc-f411525dacdc tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Deleting port 253b06d3-fdef-4152-8be6-3b6d31dc4c2a {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:24:39.870567 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-d9ef8661-8cbb-4beb-9a26-4c4b4142d9cb req-0200ba48-ff9c-48d3-88fc-f411525dacdc tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:39.958204 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-d9ef8661-8cbb-4beb-9a26-4c4b4142d9cb req-0200ba48-ff9c-48d3-88fc-f411525dacdc tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] For port 253b06d3-fdef-4152-8be6-3b6d31dc4c2a, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=253b06d3-fdef-4152-8be6-3b6d31dc4c2a,segment=NetworkSegment(51e384ca-3902-4a51-92bb-10c10d81cc09),segment_id=51e384ca-3902-4a51-92bb-10c10d81cc09)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:24:39.958552 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-d9ef8661-8cbb-4beb-9a26-4c4b4142d9cb req-0200ba48-ff9c-48d3-88fc-f411525dacdc tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:39.971414 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-d9ef8661-8cbb-4beb-9a26-4c4b4142d9cb req-0200ba48-ff9c-48d3-88fc-f411525dacdc tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Calling delete_port for 253b06d3-fdef-4152-8be6-3b6d31dc4c2a owned by compute:nova {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:24:40.095368 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-d9ef8661-8cbb-4beb-9a26-4c4b4142d9cb req-0200ba48-ff9c-48d3-88fc-f411525dacdc tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:40.106644 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['253b06d3-fdef-4152-8be6-3b6d31dc4c2a'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:24:40.123479 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0200ba48-ff9c-48d3-88fc-f411525dacdc tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Pushing event deleted for resources: {'Port': ['ID=253b06d3-fdef-4152-8be6-3b6d31dc4c2a,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:24:40.135798 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0200ba48-ff9c-48d3-88fc-f411525dacdc tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:24:40.136129 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0200ba48-ff9c-48d3-88fc-f411525dacdc tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:24:40.136459 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0200ba48-ff9c-48d3-88fc-f411525dacdc tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:24:40.136784 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0200ba48-ff9c-48d3-88fc-f411525dacdc tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:24:40.137104 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0200ba48-ff9c-48d3-88fc-f411525dacdc tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:24:40.137423 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0200ba48-ff9c-48d3-88fc-f411525dacdc tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:24:40.137752 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0200ba48-ff9c-48d3-88fc-f411525dacdc tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:24:40.138073 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0200ba48-ff9c-48d3-88fc-f411525dacdc tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:24:40.138393 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0200ba48-ff9c-48d3-88fc-f411525dacdc tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:24:40.138708 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0200ba48-ff9c-48d3-88fc-f411525dacdc tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:24:40.139016 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0200ba48-ff9c-48d3-88fc-f411525dacdc tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:24:40.139325 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0200ba48-ff9c-48d3-88fc-f411525dacdc tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:24:40.172460 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-d9ef8661-8cbb-4beb-9a26-4c4b4142d9cb req-0200ba48-ff9c-48d3-88fc-f411525dacdc tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] No DVR routers for this DVR port 253b06d3-fdef-4152-8be6-3b6d31dc4c2a on host hv-cinder-81618 {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:24:40.174942 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-d9ef8661-8cbb-4beb-9a26-4c4b4142d9cb req-0200ba48-ff9c-48d3-88fc-f411525dacdc tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:40.178251 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-d9ef8661-8cbb-4beb-9a26-4c4b4142d9cb req-0200ba48-ff9c-48d3-88fc-f411525dacdc tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.25 "DELETE /v2.0/ports/253b06d3-fdef-4152-8be6-3b6d31dc4c2a HTTP/1.1" status: 204 len: 173 time: 0.3866861 Nov 08 16:24:40.178686 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '184e206e-40e2-43b8-bcd2-e7da4021a70f', 'name': 'network-vif-deleted', 'tag': '253b06d3-fdef-4152-8be6-3b6d31dc4c2a'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:24:40.181246 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0d2a5b07-4ed8-422f-97ea-7893990e4129" -d '{"events": [{"server_uuid": "184e206e-40e2-43b8-bcd2-e7da4021a70f", "name": "network-vif-deleted", "tag": "253b06d3-fdef-4152-8be6-3b6d31dc4c2a"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:24:40.219916 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:24:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-517f4006-6e15-40d3-970b-74e39c2487fe x-openstack-request-id: req-517f4006-6e15-40d3-970b-74e39c2487fe {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:24:40.220278 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "184e206e-40e2-43b8-bcd2-e7da4021a70f", "name": "network-vif-deleted", "tag": "253b06d3-fdef-4152-8be6-3b6d31dc4c2a", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:24:40.220554 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-517f4006-6e15-40d3-970b-74e39c2487fe {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:24:40.221019 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '184e206e-40e2-43b8-bcd2-e7da4021a70f', 'name': 'network-vif-deleted', 'tag': '253b06d3-fdef-4152-8be6-3b6d31dc4c2a', 'status': 'completed', 'code': 200} Nov 08 16:24:40.608467 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-d89b1b80-1126-4610-aa1b-5cfe445bed21 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:40.680021 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-520f048c-9399-4b3b-a367-092ecae3cf91 req-4303173b-f713-432d-878a-7eaf9676eaa0 tempest-VolumesNegativeTest-1838395543 tempest-VolumesNegativeTest-1838395543-project] 10.222.0.37 "GET /v2.0/ports?device_id=184e206e-40e2-43b8-bcd2-e7da4021a70f HTTP/1.1" status: 200 len: 210 time: 0.0263813 Nov 08 16:24:41.573103 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:43.306634 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:43.965203 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:44.164636 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 253b06d3-fdef-4152-8be6-3b6d31dc4c2a no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:24:44.183327 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] No Port match for: 253b06d3-fdef-4152-8be6-3b6d31dc4c2a {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:24:44.183667 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device 253b06d3-fdef-4152-8be6-3b6d31dc4c2a not bound to the agent host hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:24:45.233922 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 44076) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:24:45.362639 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-a198a57e-f403-49d7-80e3-b50d40d6a55a admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=ad26288dfab54e44b0ef67b8ee1277bf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1275575 Nov 08 16:24:45.365167 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 44080) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:24:45.410947 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7a34c843-759b-4bdd-a470-e0cd8de68885 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:45.430917 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7a34c843-759b-4bdd-a470-e0cd8de68885 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:45.476247 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7a34c843-759b-4bdd-a470-e0cd8de68885 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:45.478921 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-7a34c843-759b-4bdd-a470-e0cd8de68885 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:45.480048 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-7a34c843-759b-4bdd-a470-e0cd8de68885 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/3a7a3dd0-8ace-462c-a701-044684af898b HTTP/1.1" status: 204 len: 168 time: 0.1139410 Nov 08 16:24:45.488068 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a34c843-759b-4bdd-a470-e0cd8de68885 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3a7a3dd0-8ace-462c-a701-044684af898b,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:24:45.495530 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a34c843-759b-4bdd-a470-e0cd8de68885 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:24:45.495850 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a34c843-759b-4bdd-a470-e0cd8de68885 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:24:45.496190 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a34c843-759b-4bdd-a470-e0cd8de68885 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:24:45.496521 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a34c843-759b-4bdd-a470-e0cd8de68885 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:24:45.496888 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a34c843-759b-4bdd-a470-e0cd8de68885 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:24:45.497158 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a34c843-759b-4bdd-a470-e0cd8de68885 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:24:45.497483 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a34c843-759b-4bdd-a470-e0cd8de68885 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:24:45.497945 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a34c843-759b-4bdd-a470-e0cd8de68885 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:24:45.498274 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a34c843-759b-4bdd-a470-e0cd8de68885 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:24:45.498595 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a34c843-759b-4bdd-a470-e0cd8de68885 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:24:45.498911 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a34c843-759b-4bdd-a470-e0cd8de68885 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:24:45.499250 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a34c843-759b-4bdd-a470-e0cd8de68885 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:24:49.757576 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:24:52.596052 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:25:08.142441 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-9a0b225c-2ade-432a-b5fa-42d5a2262299 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:25:10.610333 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-0fdad5a7-a1cf-412b-8e82-8b1dae7aec63 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:25:11.575900 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:25:12.357805 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb42f0ac-5a1a-4a10-b0b4-182aef609004 req-6a0b961b-919b-49da-a13b-c5c90b9cb5d9 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:12.359778 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fb42f0ac-5a1a-4a10-b0b4-182aef609004 req-6a0b961b-919b-49da-a13b-c5c90b9cb5d9 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 946 time: 0.0515850 Nov 08 16:25:12.407387 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-fb42f0ac-5a1a-4a10-b0b4-182aef609004 req-0a6fc6c4-cf0b-438c-b8b5-7debaf036403 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418260 Nov 08 16:25:13.313931 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:25:13.524947 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca962962-01cf-47bd-9ace-f968bf949b66 req-731e0e26-e5f3-48fa-ac07-ebc70b4d45f5 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:13.526563 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ca962962-01cf-47bd-9ace-f968bf949b66 req-731e0e26-e5f3-48fa-ac07-ebc70b4d45f5 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 946 time: 0.0480385 Nov 08 16:25:13.574337 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ca962962-01cf-47bd-9ace-f968bf949b66 req-939a9191-795f-4fe1-878e-857ae575777a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413237 Nov 08 16:25:13.968731 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:25:14.685176 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea75b9e2-1bfe-46be-9a56-fc5de5661225 req-063a9c91-732f-4b9e-843e-2224e4257771 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:14.687157 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ea75b9e2-1bfe-46be-9a56-fc5de5661225 req-063a9c91-732f-4b9e-843e-2224e4257771 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 946 time: 0.0475700 Nov 08 16:25:14.736113 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ea75b9e2-1bfe-46be-9a56-fc5de5661225 req-607c0c19-fc46-41d7-88b9-f9b4a576a478 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432749 Nov 08 16:25:15.848190 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff091c1c-305b-46f2-b9c5-a83fae7916d8 req-82595464-9c8d-4522-9529-acdcb524d459 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:15.849869 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ff091c1c-305b-46f2-b9c5-a83fae7916d8 req-82595464-9c8d-4522-9529-acdcb524d459 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 946 time: 0.0484147 Nov 08 16:25:15.898437 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ff091c1c-305b-46f2-b9c5-a83fae7916d8 req-f09ce0af-26b8-411a-97eb-a068f11e42e3 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427766 Nov 08 16:25:17.007843 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b16dd6c-02aa-47ac-aae1-37b90b344081 req-6ccbeba9-5a87-451b-b044-722692d2c8fd tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:17.009354 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6b16dd6c-02aa-47ac-aae1-37b90b344081 req-6ccbeba9-5a87-451b-b044-722692d2c8fd tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 946 time: 0.0471883 Nov 08 16:25:17.057290 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-6b16dd6c-02aa-47ac-aae1-37b90b344081 req-4850b936-8566-4e7f-9de4-c752a59bc71d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413768 Nov 08 16:25:18.171917 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1b812e4-8b4e-4d09-9053-3ceb0ebc40a0 req-44d638ce-f105-42bb-b67d-a977ef258892 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:18.173264 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e1b812e4-8b4e-4d09-9053-3ceb0ebc40a0 req-44d638ce-f105-42bb-b67d-a977ef258892 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 946 time: 0.0507367 Nov 08 16:25:18.220218 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e1b812e4-8b4e-4d09-9053-3ceb0ebc40a0 req-e6faaaa9-27f5-4ff8-acc8-78629dce1f85 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412154 Nov 08 16:25:19.330997 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-118a8c83-faea-44f8-918f-c2231737b0ac req-0eb69751-c510-44bc-accc-8be6b792f0a5 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:19.332433 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-118a8c83-faea-44f8-918f-c2231737b0ac req-0eb69751-c510-44bc-accc-8be6b792f0a5 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 946 time: 0.0476243 Nov 08 16:25:19.380267 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-118a8c83-faea-44f8-918f-c2231737b0ac req-392c952b-5d21-4b24-9e5f-754ff89c6f29 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420315 Nov 08 16:25:19.773458 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:25:20.494907 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-262d316c-fab0-46c3-a755-b3393888645a req-6a3aca2d-6587-4e2b-9970-3a14c2439df5 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:20.496631 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-262d316c-fab0-46c3-a755-b3393888645a req-6a3aca2d-6587-4e2b-9970-3a14c2439df5 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 946 time: 0.0482676 Nov 08 16:25:20.547418 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-262d316c-fab0-46c3-a755-b3393888645a req-b28d96b1-4aa0-4645-b9da-51742688fb34 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443602 Nov 08 16:25:21.659065 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43dd608d-4752-4477-ab3e-b6625afad88b req-ce11b722-4208-469c-aa6f-46c7b0095cdd tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:21.660505 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-43dd608d-4752-4477-ab3e-b6625afad88b req-ce11b722-4208-469c-aa6f-46c7b0095cdd tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 946 time: 0.0478389 Nov 08 16:25:21.707594 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-43dd608d-4752-4477-ab3e-b6625afad88b req-91dee4d4-2aff-40ce-94bc-cdc3fb1fca85 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412407 Nov 08 16:25:22.501232 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f851fb7-daab-45fc-b4af-171d2c22b511 req-eac2a201-59ab-4c60-a185-a8af626860b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:22.502719 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8f851fb7-daab-45fc-b4af-171d2c22b511 req-eac2a201-59ab-4c60-a185-a8af626860b0 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=71b067e1fbac491a8e16a4ba91049db9&device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 1099 time: 0.0407577 Nov 08 16:25:22.594173 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f851fb7-daab-45fc-b4af-171d2c22b511 req-c54fd92e-bee8-43bd-85c3-819fe0f45219 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:22.595613 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8f851fb7-daab-45fc-b4af-171d2c22b511 req-c54fd92e-bee8-43bd-85c3-819fe0f45219 service neutron] 10.222.0.25 "GET /v2.0/networks?id=f9b0f22e-a782-44ad-bfe0-8de1f795305e HTTP/1.1" status: 200 len: 910 time: 0.0844901 Nov 08 16:25:22.659053 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8f851fb7-daab-45fc-b4af-171d2c22b511 req-e3effa1f-ac13-49ce-bb1e-02c2c5e09458 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=e8c812be-3317-46f0-9044-f415824262be HTTP/1.1" status: 200 len: 1002 time: 0.0557411 Nov 08 16:25:22.711078 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f851fb7-daab-45fc-b4af-171d2c22b511 req-87c9b656-50e4-4814-adc7-9d688fa0c993 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:22.712453 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8f851fb7-daab-45fc-b4af-171d2c22b511 req-87c9b656-50e4-4814-adc7-9d688fa0c993 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=67fc8ce5-82b1-4d6d-bf54-e59b246e08c9 HTTP/1.1" status: 200 len: 848 time: 0.0456052 Nov 08 16:25:22.756687 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f851fb7-daab-45fc-b4af-171d2c22b511 req-04c0c27f-a962-4d1e-a9ae-ebdaa03e723c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:22.758129 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8f851fb7-daab-45fc-b4af-171d2c22b511 req-04c0c27f-a962-4d1e-a9ae-ebdaa03e723c service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=f9b0f22e-a782-44ad-bfe0-8de1f795305e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0383697 Nov 08 16:25:22.879417 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23df0005-8ff5-462a-a3f9-eaf730baf8d1 req-cef8565b-a0bf-4b48-a8d1-cf734aa82ec0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:22.880848 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-23df0005-8ff5-462a-a3f9-eaf730baf8d1 req-cef8565b-a0bf-4b48-a8d1-cf734aa82ec0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 946 time: 0.0977950 Nov 08 16:25:22.886241 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8f851fb7-daab-45fc-b4af-171d2c22b511 req-956eb227-179a-4209-97ff-2ace0590a584 service neutron] 10.222.0.25 "GET /v2.0/networks/f9b0f22e-a782-44ad-bfe0-8de1f795305e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1203649 Nov 08 16:25:22.975953 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-23df0005-8ff5-462a-a3f9-eaf730baf8d1 req-f026c2bb-e152-4249-9f0a-28243b1e6217 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0887341 Nov 08 16:25:23.002971 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-8f851fb7-daab-45fc-b4af-171d2c22b511 req-b33305ff-4e89-461d-a497-a55eb0d22491 service neutron] 10.222.0.25 "GET /v2.0/networks/f9b0f22e-a782-44ad-bfe0-8de1f795305e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1093271 Nov 08 16:25:24.091627 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58a40239-5097-4e0c-b516-37b06788db8c req-6598d053-34a6-443f-b463-9bcf64357595 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:24.093119 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-58a40239-5097-4e0c-b516-37b06788db8c req-6598d053-34a6-443f-b463-9bcf64357595 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 946 time: 0.0514495 Nov 08 16:25:24.140856 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-58a40239-5097-4e0c-b516-37b06788db8c req-13f4cb48-9986-497e-bceb-e1d70c91705c tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418084 Nov 08 16:25:24.304418 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f63cefb-8245-427d-ae59-464d94679fac req-94eb0cd1-3398-492a-9283-eb25abe73837 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:24.305862 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4f63cefb-8245-427d-ae59-464d94679fac req-94eb0cd1-3398-492a-9283-eb25abe73837 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=71b067e1fbac491a8e16a4ba91049db9&device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 1099 time: 0.0377402 Nov 08 16:25:24.419553 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f63cefb-8245-427d-ae59-464d94679fac req-dbed7ad1-6752-4c47-8162-8e0eeb641143 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:24.421391 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4f63cefb-8245-427d-ae59-464d94679fac req-dbed7ad1-6752-4c47-8162-8e0eeb641143 service neutron] 10.222.0.25 "GET /v2.0/networks?id=f9b0f22e-a782-44ad-bfe0-8de1f795305e HTTP/1.1" status: 200 len: 910 time: 0.0823920 Nov 08 16:25:24.487182 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4f63cefb-8245-427d-ae59-464d94679fac req-243f8046-d2f5-47d5-96a2-9031bd23c261 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=e8c812be-3317-46f0-9044-f415824262be HTTP/1.1" status: 200 len: 1002 time: 0.0565915 Nov 08 16:25:24.537045 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f63cefb-8245-427d-ae59-464d94679fac req-7b9fd822-cb44-48df-b59d-be6ce425062e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:24.538544 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4f63cefb-8245-427d-ae59-464d94679fac req-7b9fd822-cb44-48df-b59d-be6ce425062e service neutron] 10.222.0.25 "GET /v2.0/subnets?id=67fc8ce5-82b1-4d6d-bf54-e59b246e08c9 HTTP/1.1" status: 200 len: 848 time: 0.0441380 Nov 08 16:25:24.592879 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f63cefb-8245-427d-ae59-464d94679fac req-c7bf0644-a75e-4c05-87f6-4152bdae510b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:24.594566 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4f63cefb-8245-427d-ae59-464d94679fac req-c7bf0644-a75e-4c05-87f6-4152bdae510b service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=f9b0f22e-a782-44ad-bfe0-8de1f795305e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0494761 Nov 08 16:25:24.683465 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4f63cefb-8245-427d-ae59-464d94679fac req-dd0382ed-dfa4-4304-8307-ab24f0329953 service neutron] 10.222.0.25 "GET /v2.0/networks/f9b0f22e-a782-44ad-bfe0-8de1f795305e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0787103 Nov 08 16:25:25.024027 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4f63cefb-8245-427d-ae59-464d94679fac req-6f8d9859-3c8c-4ef6-968f-7a0d032f1f18 service neutron] 10.222.0.25 "GET /v2.0/networks/f9b0f22e-a782-44ad-bfe0-8de1f795305e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3333669 Nov 08 16:25:25.256749 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73dc2816-cf2e-4877-9c6b-770cf28ce300 req-cdfe2866-169a-44b5-ae90-c07314487ea5 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:25.258217 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-73dc2816-cf2e-4877-9c6b-770cf28ce300 req-cdfe2866-169a-44b5-ae90-c07314487ea5 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 946 time: 0.0506451 Nov 08 16:25:25.305303 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-73dc2816-cf2e-4877-9c6b-770cf28ce300 req-76f6cb5d-2ce6-4484-8535-636f8de6c9e5 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408933 Nov 08 16:25:25.507323 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90809e9f-bd16-41ea-bcbe-63ce6923994f req-e787569b-ebc6-4eaf-8abb-fb8b7d1fcee0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:25.508791 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-90809e9f-bd16-41ea-bcbe-63ce6923994f req-e787569b-ebc6-4eaf-8abb-fb8b7d1fcee0 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 946 time: 0.0481515 Nov 08 16:25:25.556987 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-90809e9f-bd16-41ea-bcbe-63ce6923994f req-905766a5-eb6f-415f-8a21-bb88d2281b42 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421994 Nov 08 16:25:25.578060 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 44118) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:25:25.660970 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-e43e674d-063c-4505-b1f5-3d74b39a0254 req-669673f1-39b1-4385-91c0-59bdeb97325a service neutron] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0817788 Nov 08 16:25:25.669619 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [req-e43e674d-063c-4505-b1f5-3d74b39a0254 req-fdc5bf8b-690e-4934-aa0e-814410dc43ec service neutron] http://10.222.0.37:9696/v2.0/extensions returned with HTTP 200 {{(pid=101245) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 16:25:25.670609 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [req-e43e674d-063c-4505-b1f5-3d74b39a0254 req-fdc5bf8b-690e-4934-aa0e-814410dc43ec service neutron] 10.222.0.37 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0048065 Nov 08 16:25:26.680542 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c9f6489-b4e0-4a4b-9dbd-e172122108b4 req-3b319754-3705-499e-9621-aec305733eca tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:26.681916 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4c9f6489-b4e0-4a4b-9dbd-e172122108b4 req-3b319754-3705-499e-9621-aec305733eca tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 946 time: 0.0509558 Nov 08 16:25:26.728303 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-4c9f6489-b4e0-4a4b-9dbd-e172122108b4 req-67f8ca6d-ca86-4156-a652-691e7a76b258 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399222 Nov 08 16:25:26.898416 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e43e674d-063c-4505-b1f5-3d74b39a0254 req-cbfc5c43-19b8-4201-af6a-95479f406647 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:26.899905 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e43e674d-063c-4505-b1f5-3d74b39a0254 req-cbfc5c43-19b8-4201-af6a-95479f406647 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92&tenant_id=71b067e1fbac491a8e16a4ba91049db9 HTTP/1.1" status: 200 len: 1099 time: 0.0389874 Nov 08 16:25:26.957585 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e43e674d-063c-4505-b1f5-3d74b39a0254 req-88450051-4ac6-4fe6-9ded-9918832489a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:26.958937 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e43e674d-063c-4505-b1f5-3d74b39a0254 req-88450051-4ac6-4fe6-9ded-9918832489a1 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=71b067e1fbac491a8e16a4ba91049db9&device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 1099 time: 0.0369570 Nov 08 16:25:27.046903 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e43e674d-063c-4505-b1f5-3d74b39a0254 req-87a13d1e-3c2d-4a56-8d96-8ec49c593124 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:27.048288 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e43e674d-063c-4505-b1f5-3d74b39a0254 req-87a13d1e-3c2d-4a56-8d96-8ec49c593124 service neutron] 10.222.0.25 "GET /v2.0/networks?id=f9b0f22e-a782-44ad-bfe0-8de1f795305e HTTP/1.1" status: 200 len: 910 time: 0.0821047 Nov 08 16:25:27.113336 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e43e674d-063c-4505-b1f5-3d74b39a0254 req-87022d34-655c-465b-90ee-62e812df9a90 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=e8c812be-3317-46f0-9044-f415824262be HTTP/1.1" status: 200 len: 1002 time: 0.0565596 Nov 08 16:25:27.164263 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e43e674d-063c-4505-b1f5-3d74b39a0254 req-b611f29a-12bc-47df-beac-d2367765d6fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:27.165637 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e43e674d-063c-4505-b1f5-3d74b39a0254 req-b611f29a-12bc-47df-beac-d2367765d6fb service neutron] 10.222.0.25 "GET /v2.0/subnets?id=67fc8ce5-82b1-4d6d-bf54-e59b246e08c9 HTTP/1.1" status: 200 len: 848 time: 0.0447869 Nov 08 16:25:27.207560 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e43e674d-063c-4505-b1f5-3d74b39a0254 req-9fee4554-b37c-41ad-939a-1cca3e30803c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:27.209014 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e43e674d-063c-4505-b1f5-3d74b39a0254 req-9fee4554-b37c-41ad-939a-1cca3e30803c service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=f9b0f22e-a782-44ad-bfe0-8de1f795305e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0364747 Nov 08 16:25:27.296277 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e43e674d-063c-4505-b1f5-3d74b39a0254 req-e66c3aa3-6904-469a-b040-fcc5d07c3f31 service neutron] 10.222.0.25 "GET /v2.0/networks/f9b0f22e-a782-44ad-bfe0-8de1f795305e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0776308 Nov 08 16:25:27.384193 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e43e674d-063c-4505-b1f5-3d74b39a0254 req-6d55a818-361e-4ec1-af1d-3ef4b6c41ef8 service neutron] 10.222.0.25 "GET /v2.0/networks/f9b0f22e-a782-44ad-bfe0-8de1f795305e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0811341 Nov 08 16:25:27.839731 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2d8188c-173e-4261-a73c-167331d8defd req-595400fd-a9e2-46bc-8402-83de2d69f88a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:27.841170 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a2d8188c-173e-4261-a73c-167331d8defd req-595400fd-a9e2-46bc-8402-83de2d69f88a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 946 time: 0.0470328 Nov 08 16:25:27.889181 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-a2d8188c-173e-4261-a73c-167331d8defd req-cd06d6b4-fdcf-4ee7-bf01-2b5038f2e60a tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417187 Nov 08 16:25:28.432835 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device e8c812be-3317-46f0-9044-f415824262be no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:25:28.507637 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:25:28.528879 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8472eae0-c7a0-4a09-855d-0d96cce75e92', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e8c812be-3317-46f0-9044-f415824262be'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:25:28.531106 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d11b0619-7370-4105-8937-c5bb95a1e926" -d '{"events": [{"server_uuid": "8472eae0-c7a0-4a09-855d-0d96cce75e92", "name": "network-vif-unplugged", "status": "completed", "tag": "e8c812be-3317-46f0-9044-f415824262be"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:25:28.543049 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port e8c812be-3317-46f0-9044-f415824262be, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=e8c812be-3317-46f0-9044-f415824262be,segment=NetworkSegment(d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c),segment_id=d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:25:28.547920 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:25:28.570518 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Mon, 08 Nov 2021 16:25:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-23b39d04-77ca-420b-b2c5-a0e1a8cb7f02 x-openstack-request-id: req-23b39d04-77ca-420b-b2c5-a0e1a8cb7f02 {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:25:28.570802 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8472eae0-c7a0-4a09-855d-0d96cce75e92", "name": "network-vif-unplugged", "status": "completed", "tag": "e8c812be-3317-46f0-9044-f415824262be", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:25:28.571050 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-23b39d04-77ca-420b-b2c5-a0e1a8cb7f02 {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:25:28.571432 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8472eae0-c7a0-4a09-855d-0d96cce75e92', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e8c812be-3317-46f0-9044-f415824262be', 'code': 200} Nov 08 16:25:28.595775 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=e8c812be-3317-46f0-9044-f415824262be,revision_number=6']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:25:28.603675 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:25:28.604264 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:25:28.604847 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:25:28.605427 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:25:28.606039 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:25:28.606623 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:25:28.607203 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:25:28.607787 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:25:28.608389 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:25:28.608978 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:25:28.609550 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:25:28.610246 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:25:29.003491 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-899e34ee-a0c9-46c5-9554-c6d4cc2940b0 req-8ab5530c-de77-42f8-93c6-6559cb9fe647 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:29.004927 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-899e34ee-a0c9-46c5-9554-c6d4cc2940b0 req-8ab5530c-de77-42f8-93c6-6559cb9fe647 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 944 time: 0.0506625 Nov 08 16:25:29.052097 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-899e34ee-a0c9-46c5-9554-c6d4cc2940b0 req-c12c9a8f-106f-4d38-807c-33ddbecabe50 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412800 Nov 08 16:25:29.594488 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:25:30.166610 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc6750f3-a019-46cd-aafd-f3a2ee431d3e req-189adc5f-30ad-4a07-b563-c322644394c5 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:30.167991 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cc6750f3-a019-46cd-aafd-f3a2ee431d3e req-189adc5f-30ad-4a07-b563-c322644394c5 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 944 time: 0.0484872 Nov 08 16:25:30.217899 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-cc6750f3-a019-46cd-aafd-f3a2ee431d3e req-9a9d8570-b281-4b93-8ca0-40ffbd88d883 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425751 Nov 08 16:25:31.330302 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0027f2ae-af2d-47d0-b872-d1e69e82755a req-6dc8602d-9f6d-43fb-84ff-b48322929cfa tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:31.331751 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0027f2ae-af2d-47d0-b872-d1e69e82755a req-6dc8602d-9f6d-43fb-84ff-b48322929cfa tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 944 time: 0.0477314 Nov 08 16:25:31.382470 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-0027f2ae-af2d-47d0-b872-d1e69e82755a req-7772025f-bf7b-40c7-bb00-bee8e9306792 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450146 Nov 08 16:25:32.494908 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e258a53-d42b-4ee2-940b-c527765742d1 req-de43b80c-5a47-409a-8f0e-d3ee174a2569 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:32.496728 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5e258a53-d42b-4ee2-940b-c527765742d1 req-de43b80c-5a47-409a-8f0e-d3ee174a2569 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 944 time: 0.0480058 Nov 08 16:25:32.544652 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5e258a53-d42b-4ee2-940b-c527765742d1 req-cef46201-3da2-4505-8c48-838f3a024158 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417707 Nov 08 16:25:33.655275 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f16c013-6846-4262-832d-b28e7f80dc66 req-0e78ec0c-61e7-486d-ab8a-1a542112e267 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:33.656719 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5f16c013-6846-4262-832d-b28e7f80dc66 req-0e78ec0c-61e7-486d-ab8a-1a542112e267 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 944 time: 0.0473807 Nov 08 16:25:33.704195 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-5f16c013-6846-4262-832d-b28e7f80dc66 req-3de5c572-f461-41bc-928c-69987c70a4d4 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416832 Nov 08 16:25:34.442981 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-247f589e-bdfd-4761-b487-b4c4646f5aa1 req-2aea1c6d-a72d-4234-99b5-d01d610357cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:34.444395 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-247f589e-bdfd-4761-b487-b4c4646f5aa1 req-2aea1c6d-a72d-4234-99b5-d01d610357cd service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 1097 time: 0.0415251 Nov 08 16:25:34.489279 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-247f589e-bdfd-4761-b487-b4c4646f5aa1 req-17924312-a598-4593-9931-77d5c7889431 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0370677 Nov 08 16:25:34.815212 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b41ccb-89ed-4ce3-8624-6a34a212a8c0 req-11e49576-2022-4e04-a32a-53f121562cc9 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:34.816639 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-12b41ccb-89ed-4ce3-8624-6a34a212a8c0 req-11e49576-2022-4e04-a32a-53f121562cc9 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 944 time: 0.0472226 Nov 08 16:25:34.862877 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-12b41ccb-89ed-4ce3-8624-6a34a212a8c0 req-3648565e-12da-4653-9e91-a82e8e3212f9 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404809 Nov 08 16:25:35.975821 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e36f7747-46ae-431a-be41-fc1d50d097ae req-1a2eede3-9b1f-4651-adef-61312df5e90b tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:25:35.977273 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e36f7747-46ae-431a-be41-fc1d50d097ae req-1a2eede3-9b1f-4651-adef-61312df5e90b tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 944 time: 0.0483015 Nov 08 16:25:36.029385 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-e36f7747-46ae-431a-be41-fc1d50d097ae req-688dec62-d479-42bd-bc46-6145da271ee5 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461941 Nov 08 16:25:36.465522 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device e8c812be-3317-46f0-9044-f415824262be details requested by agent hyperv_hv-cinder-81618 with host hv-cinder-81618 {{(pid=101246) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 16:25:36.557927 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port e8c812be-3317-46f0-9044-f415824262be, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=e8c812be-3317-46f0-9044-f415824262be,segment=NetworkSegment(d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c),segment_id=d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:25:36.568966 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Returning: {'device': 'e8c812be-3317-46f0-9044-f415824262be', 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e', 'port_id': 'e8c812be-3317-46f0-9044-f415824262be', 'mac_address': 'fa:16:3e:9e:7b:a0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 190, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101246) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 16:25:36.603432 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:25:36.615726 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e8c812be-3317-46f0-9044-f415824262be {{(pid=101246) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 16:25:36.634983 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port e8c812be-3317-46f0-9044-f415824262be, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=e8c812be-3317-46f0-9044-f415824262be,segment=NetworkSegment(d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c),segment_id=d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:25:36.638844 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:25:36.687591 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=e8c812be-3317-46f0-9044-f415824262be,revision_number=7']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:25:36.979661 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] get_ports_and_sgs() called for port_ids ['e8c812be-3317-46f0-9044-f415824262be'] {{(pid=101246) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 16:25:38.143404 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-29cc6d2c-9f95-41cd-9942-c3a23c5ecb6f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:25:38.481121 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device e8c812be-3317-46f0-9044-f415824262be up at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 16:25:38.527983 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.provisioning_blocks [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Provisioning complete for port e8c812be-3317-46f0-9044-f415824262be triggered by entity L2. {{(pid=101246) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 16:25:38.528346 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-883664'] for port, provisioning_complete {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:25:38.603819 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-582424'] for port, before_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:25:38.625272 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8472eae0-c7a0-4a09-855d-0d96cce75e92', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e8c812be-3317-46f0-9044-f415824262be'}] {{(pid=101246) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:25:38.627687 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29b0dd44de59f0bd5087547b5394a9d35fc52c9e6f85a67ce9dcfb097f329aa6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f2aae8cc-684b-47a4-877b-d89d944f27f9" -d '{"events": [{"server_uuid": "8472eae0-c7a0-4a09-855d-0d96cce75e92", "name": "network-vif-plugged", "status": "completed", "tag": "e8c812be-3317-46f0-9044-f415824262be"}]}' {{(pid=101246) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:25:38.640359 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.db [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] For port e8c812be-3317-46f0-9044-f415824262be, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=e8c812be-3317-46f0-9044-f415824262be,segment=NetworkSegment(d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c),segment_id=d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c)] {{(pid=101246) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:25:38.644625 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792877257620', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792876777373', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792876777391'] for port, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:25:38.672873 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:25:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f1b6e4ff-8ccc-478f-a293-ae3e444428a3 x-openstack-request-id: req-f1b6e4ff-8ccc-478f-a293-ae3e444428a3 {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:25:38.673269 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8472eae0-c7a0-4a09-855d-0d96cce75e92", "name": "network-vif-plugged", "status": "completed", "tag": "e8c812be-3317-46f0-9044-f415824262be", "code": 200}]} {{(pid=101246) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:25:38.673503 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-f1b6e4ff-8ccc-478f-a293-ae3e444428a3 {{(pid=101246) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:25:38.673912 dv-cinder-816187-2-iscsi neutron-server[101246]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8472eae0-c7a0-4a09-855d-0d96cce75e92', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e8c812be-3317-46f0-9044-f415824262be', 'code': 200} Nov 08 16:25:38.698027 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Pushing event updated for resources: {'Port': ['ID=e8c812be-3317-46f0-9044-f415824262be,revision_number=8']} {{(pid=101246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:25:40.610585 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-73373b3b-e9f8-4228-9782-a787e3e50f57 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:25:41.578758 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:25:43.313436 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:25:43.969879 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:25:49.776317 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:26:06.593913 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:26:08.144916 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-bb2641f2-c7c4-4022-9f6d-f8581efa831b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:26:10.611455 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-10ba0550-6474-4130-bad9-a2fd1e17dbc0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:26:11.579958 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:26:13.314333 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:26:13.970865 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:26:19.780222 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:26:25.270664 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dc250a1f-8c84-42e8-a5ab-1b9f8214992d req-1a44e6c4-af62-4e52-b282-8591ed108c1b service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0385144 Nov 08 16:26:25.351813 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc250a1f-8c84-42e8-a5ab-1b9f8214992d req-41c754c2-12d4-4d59-90fa-2d451df00b07 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:26:25.353174 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dc250a1f-8c84-42e8-a5ab-1b9f8214992d req-41c754c2-12d4-4d59-90fa-2d451df00b07 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=71b067e1fbac491a8e16a4ba91049db9&device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 1099 time: 0.0384650 Nov 08 16:26:25.456663 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc250a1f-8c84-42e8-a5ab-1b9f8214992d req-5410316c-2145-4fdc-ac82-4fbf1c8f2042 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:26:25.458154 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dc250a1f-8c84-42e8-a5ab-1b9f8214992d req-5410316c-2145-4fdc-ac82-4fbf1c8f2042 service neutron] 10.222.0.25 "GET /v2.0/networks?id=f9b0f22e-a782-44ad-bfe0-8de1f795305e HTTP/1.1" status: 200 len: 910 time: 0.0846813 Nov 08 16:26:25.523413 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dc250a1f-8c84-42e8-a5ab-1b9f8214992d req-5f4e96ee-746e-40d9-a849-9b7dd6cbee96 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=e8c812be-3317-46f0-9044-f415824262be HTTP/1.1" status: 200 len: 1002 time: 0.0565066 Nov 08 16:26:25.573772 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc250a1f-8c84-42e8-a5ab-1b9f8214992d req-f14322e7-b3ab-4266-a8f8-3a17215c0566 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:26:25.575193 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dc250a1f-8c84-42e8-a5ab-1b9f8214992d req-f14322e7-b3ab-4266-a8f8-3a17215c0566 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=67fc8ce5-82b1-4d6d-bf54-e59b246e08c9 HTTP/1.1" status: 200 len: 848 time: 0.0429139 Nov 08 16:26:25.624243 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc250a1f-8c84-42e8-a5ab-1b9f8214992d req-ddbc6359-4902-4b4f-b0f7-e4e51f052f97 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:26:25.625619 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dc250a1f-8c84-42e8-a5ab-1b9f8214992d req-ddbc6359-4902-4b4f-b0f7-e4e51f052f97 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=f9b0f22e-a782-44ad-bfe0-8de1f795305e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0416827 Nov 08 16:26:25.711717 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dc250a1f-8c84-42e8-a5ab-1b9f8214992d req-87ce556b-8a66-4ec6-bd41-b2ad4eb56ab2 service neutron] 10.222.0.25 "GET /v2.0/networks/f9b0f22e-a782-44ad-bfe0-8de1f795305e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0782526 Nov 08 16:26:25.805554 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-dc250a1f-8c84-42e8-a5ab-1b9f8214992d req-4f0c3fd0-b9b4-40f8-9004-e35ec6d6811e service neutron] 10.222.0.25 "GET /v2.0/networks/f9b0f22e-a782-44ad-bfe0-8de1f795305e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0850871 Nov 08 16:26:38.146751 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6e2b3fe9-3473-4a5e-9d93-02e19d28b433 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:26:40.613190 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-1b34e997-8aef-47f0-b076-d68de5514768 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:26:41.583325 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:26:42.433448 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [req-f493bbcd-e014-4edc-affd-4f127802b5c4 req-db84c637-72ed-41e6-9d67-f8ec82c1435d service neutron] (101245) timed out ('10.222.0.25', 50844) {{(pid=101245) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 08 16:26:43.318569 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:26:43.591652 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:26:43.783352 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [req-2cfdad63-c283-4c3f-bb56-1195e8f7e21a req-3083dbb0-d20e-45ac-86e6-e161bf53e4a3 service neutron] (101244) timed out ('10.222.0.25', 50860) {{(pid=101244) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 08 16:26:43.971349 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:26:49.785766 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:03.622917 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 44170) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:27:03.861825 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Deleting port 24df82d8-daf0-4261-9682-8203fdc8ebba {{(pid=101245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:27:03.862173 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:03.934064 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:03.934388 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:03.945664 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling delete_port for 24df82d8-daf0-4261-9682-8203fdc8ebba owned by network:floatingip {{(pid=101245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:27:04.086776 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:04.109843 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Pushing event deleted for resources: {'Port': ['ID=24df82d8-daf0-4261-9682-8203fdc8ebba,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:27:04.123676 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:27:04.124024 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:27:04.124357 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:27:04.124689 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:27:04.125014 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:27:04.125335 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:27:04.125656 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:27:04.125996 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:27:04.126316 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:27:04.126632 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:27:04.126944 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:27:04.127256 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:27:04.182351 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for floatingip, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:04.182597 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.db.l3_db [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Floating IP 0f10dbe9-01e2-4cd5-aabf-675e868d61a2 disassociated (deleted). External IP: 172.27.3.161, port: e8c812be-3317-46f0-9044-f415824262be. Nov 08 16:27:04.377232 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Router 775c558e-eb61-4b1c-80f7-d59df2812bdc has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101245) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:27:04.476003 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101245) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:27:04.480841 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for floatingip, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:04.485379 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-209e96f8-85e0-45a0-8401-b8d49574fa90 None None] Sync routers for ids ['775c558e-eb61-4b1c-80f7-d59df2812bdc'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:27:04.494889 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-209e96f8-85e0-45a0-8401-b8d49574fa90 None None] Routers {'775c558e-eb61-4b1c-80f7-d59df2812bdc'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:27:04.495569 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-209e96f8-85e0-45a0-8401-b8d49574fa90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:26:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['775c558e-eb61-4b1c-80f7-d59df2812bdc'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:27:04.510225 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-bdc9a628-1f06-49f7-92eb-c3d993e6ca7e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "DELETE /v2.0/floatingips/0f10dbe9-01e2-4cd5-aabf-675e868d61a2 HTTP/1.1" status: 204 len: 168 time: 0.8862984 Nov 08 16:27:04.510813 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8472eae0-c7a0-4a09-855d-0d96cce75e92', 'tag': 'e8c812be-3317-46f0-9044-f415824262be'}] {{(pid=101245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:27:04.513044 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9303bddee447de525cefc409d3d14f9dbe8ef1f21bfe9eb24fdef2609d4aa3c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-70757a2f-49d3-419a-a86b-d3db23e9c4db" -d '{"events": [{"name": "network-changed", "server_uuid": "8472eae0-c7a0-4a09-855d-0d96cce75e92", "tag": "e8c812be-3317-46f0-9044-f415824262be"}]}' {{(pid=101245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:27:04.609564 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-209e96f8-85e0-45a0-8401-b8d49574fa90 None None] Set router 775c558e-eb61-4b1c-80f7-d59df2812bdc gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:27:04.715814 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 16:27:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f5a75995-6366-403e-bbad-5f0f68125832 x-openstack-request-id: req-f5a75995-6366-403e-bbad-5f0f68125832 {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:27:04.716329 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8472eae0-c7a0-4a09-855d-0d96cce75e92", "tag": "e8c812be-3317-46f0-9044-f415824262be", "status": "completed", "code": 200}]} {{(pid=101245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:27:04.716329 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-f5a75995-6366-403e-bbad-5f0f68125832 {{(pid=101245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:27:04.716728 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8472eae0-c7a0-4a09-855d-0d96cce75e92', 'tag': 'e8c812be-3317-46f0-9044-f415824262be', 'status': 'completed', 'code': 200} Nov 08 16:27:04.823346 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab951a06-1db4-4f26-adb8-523d3393075d req-882fb3e4-6bfa-41c6-b82e-2ffcbf75302e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:27:04.824830 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ab951a06-1db4-4f26-adb8-523d3393075d req-882fb3e4-6bfa-41c6-b82e-2ffcbf75302e tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 946 time: 0.1402240 Nov 08 16:27:04.827931 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-209e96f8-85e0-45a0-8401-b8d49574fa90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'name': 'tempest-TestShelveInstance-1067069244-router', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52'}], 'enable_snat': True}, 'gw_port_id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:21:45Z', 'updated_at': '2021-11-08T16:21:49Z', 'revision_number': 4, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'gw_port': {'id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:5b:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 566, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:46Z', 'updated_at': '2021-11-08T16:21:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '3a14a839-f3ee-4231-a9b5-00067b56ef01', 'name': '', 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'mac_address': 'fa:16:3e:94:f9:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'device_owner': 'network:router_interface', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:48Z', 'updated_at': '2021-11-08T16:21:55Z', 'revision_number': 5, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'subnets': [{'id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:27:04.852354 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70757a2f-49d3-419a-a86b-d3db23e9c4db req-1eac13a2-7ab5-46b0-a116-2c684cf34b60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:27:04.853869 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-70757a2f-49d3-419a-a86b-d3db23e9c4db req-1eac13a2-7ab5-46b0-a116-2c684cf34b60 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=71b067e1fbac491a8e16a4ba91049db9&device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 1099 time: 0.1096103 Nov 08 16:27:04.857520 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-209e96f8-85e0-45a0-8401-b8d49574fa90 None None] Checking router: 775c558e-eb61-4b1c-80f7-d59df2812bdc for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:27:04.866229 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-209e96f8-85e0-45a0-8401-b8d49574fa90 None None] Routers {'775c558e-eb61-4b1c-80f7-d59df2812bdc'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:27:04.866837 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-209e96f8-85e0-45a0-8401-b8d49574fa90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:26:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['775c558e-eb61-4b1c-80f7-d59df2812bdc'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:27:04.927734 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-ab951a06-1db4-4f26-adb8-523d3393075d req-b2d07fd2-f169-4321-8550-039f51b1a5b1 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0959351 Nov 08 16:27:04.966185 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70757a2f-49d3-419a-a86b-d3db23e9c4db req-38fd7b3d-d7ae-48fa-9dee-4eb7ef7365af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:27:04.967648 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-70757a2f-49d3-419a-a86b-d3db23e9c4db req-38fd7b3d-d7ae-48fa-9dee-4eb7ef7365af service neutron] 10.222.0.25 "GET /v2.0/networks?id=f9b0f22e-a782-44ad-bfe0-8de1f795305e HTTP/1.1" status: 200 len: 910 time: 0.1028740 Nov 08 16:27:04.970073 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-209e96f8-85e0-45a0-8401-b8d49574fa90 None None] Set router 775c558e-eb61-4b1c-80f7-d59df2812bdc gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:27:05.010632 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-70757a2f-49d3-419a-a86b-d3db23e9c4db req-b1129f13-1ac5-47e7-8a91-ac539ae905db service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=e8c812be-3317-46f0-9044-f415824262be HTTP/1.1" status: 200 len: 217 time: 0.0343916 Nov 08 16:27:05.064662 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70757a2f-49d3-419a-a86b-d3db23e9c4db req-c83e5c09-449f-4fef-93b8-c1ea8891f7cf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:27:05.066194 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-70757a2f-49d3-419a-a86b-d3db23e9c4db req-c83e5c09-449f-4fef-93b8-c1ea8891f7cf service neutron] 10.222.0.25 "GET /v2.0/subnets?id=67fc8ce5-82b1-4d6d-bf54-e59b246e08c9 HTTP/1.1" status: 200 len: 848 time: 0.0478857 Nov 08 16:27:05.114334 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70757a2f-49d3-419a-a86b-d3db23e9c4db req-d2234047-2295-400b-b532-4574bc905ef2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:27:05.116131 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-70757a2f-49d3-419a-a86b-d3db23e9c4db req-d2234047-2295-400b-b532-4574bc905ef2 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=f9b0f22e-a782-44ad-bfe0-8de1f795305e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0413082 Nov 08 16:27:05.169890 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-209e96f8-85e0-45a0-8401-b8d49574fa90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'name': 'tempest-TestShelveInstance-1067069244-router', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52'}], 'enable_snat': True}, 'gw_port_id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:21:45Z', 'updated_at': '2021-11-08T16:21:49Z', 'revision_number': 4, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'gw_port': {'id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:5b:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 566, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:46Z', 'updated_at': '2021-11-08T16:21:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '3a14a839-f3ee-4231-a9b5-00067b56ef01', 'name': '', 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'mac_address': 'fa:16:3e:94:f9:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'device_owner': 'network:router_interface', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:48Z', 'updated_at': '2021-11-08T16:21:55Z', 'revision_number': 5, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'subnets': [{'id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:27:05.195507 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-209e96f8-85e0-45a0-8401-b8d49574fa90 None None] The sync data for ids ['775c558e-eb61-4b1c-80f7-d59df2812bdc'] in dv-cinder-816187-2-iscsi is: [{'id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'name': 'tempest-TestShelveInstance-1067069244-router', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52'}], 'enable_snat': True}, 'gw_port_id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:21:45Z', 'updated_at': '2021-11-08T16:21:49Z', 'revision_number': 4, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'gw_port': {'id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:5b:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 566, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:46Z', 'updated_at': '2021-11-08T16:21:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi', '_interfaces': [{'id': '3a14a839-f3ee-4231-a9b5-00067b56ef01', 'name': '', 'network_id': 'f9b0f22e-a782-44ad-bfe0-8de1f795305e', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'mac_address': 'fa:16:3e:94:f9:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'device_owner': 'network:router_interface', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:48Z', 'updated_at': '2021-11-08T16:21:55Z', 'revision_number': 5, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'subnets': [{'id': '67fc8ce5-82b1-4d6d-bf54-e59b246e08c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:27:05.204641 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-70757a2f-49d3-419a-a86b-d3db23e9c4db req-bd7fdf9d-c90e-495e-bd5d-4067b386f2db service neutron] 10.222.0.25 "GET /v2.0/networks/f9b0f22e-a782-44ad-bfe0-8de1f795305e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0809858 Nov 08 16:27:05.299591 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-70757a2f-49d3-419a-a86b-d3db23e9c4db req-12533709-706d-403d-82ae-8a4cd4b91e54 service neutron] 10.222.0.25 "GET /v2.0/networks/f9b0f22e-a782-44ad-bfe0-8de1f795305e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0866063 Nov 08 16:27:05.404055 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d870499-3c0c-4631-aa56-181b805539e3 None None] New status for floating IP 0f10dbe9-01e2-4cd5-aabf-675e868d61a2: DOWN {{(pid=101247) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 16:27:06.095012 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-871a0906-93f3-4f4c-b2ee-b674304de2d8 req-dd4d17a9-20d4-45c7-bda1-b912edfd0572 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:27:06.096517 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-871a0906-93f3-4f4c-b2ee-b674304de2d8 req-dd4d17a9-20d4-45c7-bda1-b912edfd0572 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 946 time: 0.0992167 Nov 08 16:27:06.144773 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-871a0906-93f3-4f4c-b2ee-b674304de2d8 req-3f709c7c-c681-43a7-b040-e2c6d4bf6f57 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/security-groups?id=da359123-5a1e-4b60-8d5a-f50c1ee0c53b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424280 Nov 08 16:27:06.376408 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb566a2e-3058-4f1d-aee3-99d7a1a4c76e req-9bd5afcc-d31a-4f7e-86de-491b68f5d3f3 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 16:27:06.377844 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bb566a2e-3058-4f1d-aee3-99d7a1a4c76e req-9bd5afcc-d31a-4f7e-86de-491b68f5d3f3 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.25 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 946 time: 0.0500605 Nov 08 16:27:06.462854 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-bb566a2e-3058-4f1d-aee3-99d7a1a4c76e req-d6db51c5-1eef-4d1a-a574-1c61180c8668 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Deleting port e8c812be-3317-46f0-9044-f415824262be {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:27:06.463191 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-bb566a2e-3058-4f1d-aee3-99d7a1a4c76e req-d6db51c5-1eef-4d1a-a574-1c61180c8668 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:06.551407 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [req-bb566a2e-3058-4f1d-aee3-99d7a1a4c76e req-d6db51c5-1eef-4d1a-a574-1c61180c8668 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] For port e8c812be-3317-46f0-9044-f415824262be, host hv-cinder-81618, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81618',level=0,port_id=e8c812be-3317-46f0-9044-f415824262be,segment=NetworkSegment(d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c),segment_id=d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:27:06.551767 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-bb566a2e-3058-4f1d-aee3-99d7a1a4c76e req-d6db51c5-1eef-4d1a-a574-1c61180c8668 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:06.564422 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [req-bb566a2e-3058-4f1d-aee3-99d7a1a4c76e req-d6db51c5-1eef-4d1a-a574-1c61180c8668 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Calling delete_port for e8c812be-3317-46f0-9044-f415824262be owned by compute:nova {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:27:06.683948 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-bb566a2e-3058-4f1d-aee3-99d7a1a4c76e req-d6db51c5-1eef-4d1a-a574-1c61180c8668 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:06.713906 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6db51c5-1eef-4d1a-a574-1c61180c8668 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Pushing event deleted for resources: {'Port': ['ID=e8c812be-3317-46f0-9044-f415824262be,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:27:06.723312 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6db51c5-1eef-4d1a-a574-1c61180c8668 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:27:06.723657 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6db51c5-1eef-4d1a-a574-1c61180c8668 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:27:06.723991 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6db51c5-1eef-4d1a-a574-1c61180c8668 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:27:06.724321 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6db51c5-1eef-4d1a-a574-1c61180c8668 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:27:06.724648 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6db51c5-1eef-4d1a-a574-1c61180c8668 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:27:06.724972 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6db51c5-1eef-4d1a-a574-1c61180c8668 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:27:06.725294 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6db51c5-1eef-4d1a-a574-1c61180c8668 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:27:06.725615 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6db51c5-1eef-4d1a-a574-1c61180c8668 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:27:06.726347 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6db51c5-1eef-4d1a-a574-1c61180c8668 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:27:06.726347 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6db51c5-1eef-4d1a-a574-1c61180c8668 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:27:06.726551 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6db51c5-1eef-4d1a-a574-1c61180c8668 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:27:06.726873 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6db51c5-1eef-4d1a-a574-1c61180c8668 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816187-2-iscsi {{(pid=101244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 16:27:06.765725 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [req-bb566a2e-3058-4f1d-aee3-99d7a1a4c76e req-d6db51c5-1eef-4d1a-a574-1c61180c8668 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] No DVR routers for this DVR port e8c812be-3317-46f0-9044-f415824262be on host hv-cinder-81618 {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:27:06.768176 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [req-bb566a2e-3058-4f1d-aee3-99d7a1a4c76e req-d6db51c5-1eef-4d1a-a574-1c61180c8668 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-406935'] for port, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:06.772114 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bb566a2e-3058-4f1d-aee3-99d7a1a4c76e req-d6db51c5-1eef-4d1a-a574-1c61180c8668 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.25 "DELETE /v2.0/ports/e8c812be-3317-46f0-9044-f415824262be HTTP/1.1" status: 204 len: 173 time: 0.3881798 Nov 08 16:27:06.772549 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8472eae0-c7a0-4a09-855d-0d96cce75e92', 'name': 'network-vif-deleted', 'tag': 'e8c812be-3317-46f0-9044-f415824262be'}] {{(pid=101244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 16:27:06.774888 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.37/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ef25f294114062e4ca86fab953273555e037eb3cac00b696553b1353daa9c77" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9b5f9da7-da5b-45ec-8d80-8bcc7197efca" -d '{"events": [{"server_uuid": "8472eae0-c7a0-4a09-855d-0d96cce75e92", "name": "network-vif-deleted", "tag": "e8c812be-3317-46f0-9044-f415824262be"}]}' {{(pid=101244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 16:27:06.814192 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 16:27:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-de0bab67-d23d-4d73-856a-4cfdf609878d x-openstack-request-id: req-de0bab67-d23d-4d73-856a-4cfdf609878d {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 16:27:06.814490 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8472eae0-c7a0-4a09-855d-0d96cce75e92", "name": "network-vif-deleted", "tag": "e8c812be-3317-46f0-9044-f415824262be", "status": "completed", "code": 200}]} {{(pid=101244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 16:27:06.814740 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.37/compute/v2.1/os-server-external-events used request id req-de0bab67-d23d-4d73-856a-4cfdf609878d {{(pid=101244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 16:27:06.815160 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8472eae0-c7a0-4a09-855d-0d96cce75e92', 'name': 'network-vif-deleted', 'tag': 'e8c812be-3317-46f0-9044-f415824262be', 'status': 'completed', 'code': 200} Nov 08 16:27:07.258530 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [req-bea1b591-d0f1-4960-a638-801ff398f87d req-d8abc4f3-8f1c-4630-b18e-ee0f07ce98a5 tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "GET /v2.0/ports?device_id=8472eae0-c7a0-4a09-855d-0d96cce75e92 HTTP/1.1" status: 200 len: 210 time: 0.0263610 Nov 08 16:27:08.151759 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-9c2dcc0f-2ce2-4bf9-9be6-7828d11ef425 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:08.312886 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 44208) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:27:08.367328 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bde163a9-c140-4b07-8fdc-57715d6d8a6d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for security_group, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:08.391406 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bde163a9-c140-4b07-8fdc-57715d6d8a6d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:08.446744 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bde163a9-c140-4b07-8fdc-57715d6d8a6d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:08.449803 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-bde163a9-c140-4b07-8fdc-57715d6d8a6d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Publish callbacks [] for security_group, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:08.451077 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-bde163a9-c140-4b07-8fdc-57715d6d8a6d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] 10.222.0.37 "DELETE /v2.0/security-groups/da359123-5a1e-4b60-8d5a-f50c1ee0c53b HTTP/1.1" status: 204 len: 168 time: 0.1372063 Nov 08 16:27:08.459814 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bde163a9-c140-4b07-8fdc-57715d6d8a6d tempest-TestShelveInstance-939190200 tempest-TestShelveInstance-939190200-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=da359123-5a1e-4b60-8d5a-f50c1ee0c53b,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:27:08.496803 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 44212) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:27:08.920992 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-dd13e7f5-3331-4155-8ad8-b7db204227c0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-2033295'] for router_interface, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:09.160343 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-dd13e7f5-3331-4155-8ad8-b7db204227c0 admin admin] Deleting port 3a14a839-f3ee-4231-a9b5-00067b56ef01 {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:27:09.160678 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-dd13e7f5-3331-4155-8ad8-b7db204227c0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:09.235231 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [None req-dd13e7f5-3331-4155-8ad8-b7db204227c0 admin admin] For port 3a14a839-f3ee-4231-a9b5-00067b56ef01, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=3a14a839-f3ee-4231-a9b5-00067b56ef01,segment=NetworkSegment(d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c),segment_id=d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:27:09.235503 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-dd13e7f5-3331-4155-8ad8-b7db204227c0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:09.248611 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-dd13e7f5-3331-4155-8ad8-b7db204227c0 admin admin] Calling delete_port for 3a14a839-f3ee-4231-a9b5-00067b56ef01 owned by network:router_interface {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:27:09.423621 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-dd13e7f5-3331-4155-8ad8-b7db204227c0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:09.452937 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd13e7f5-3331-4155-8ad8-b7db204227c0 admin admin] Pushing event deleted for resources: {'Port': ['ID=3a14a839-f3ee-4231-a9b5-00067b56ef01,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:27:09.618503 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-dd13e7f5-3331-4155-8ad8-b7db204227c0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1599532', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-2034495'] for router_interface, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:10.069342 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dd13e7f5-3331-4155-8ad8-b7db204227c0 admin admin] Router 775c558e-eb61-4b1c-80f7-d59df2812bdc has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:27:10.172447 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dd13e7f5-3331-4155-8ad8-b7db204227c0 admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:27:10.177362 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-dd13e7f5-3331-4155-8ad8-b7db204227c0 admin admin] 10.222.0.37 "PUT /v2.0/routers/775c558e-eb61-4b1c-80f7-d59df2812bdc/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6791298 Nov 08 16:27:10.179881 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 44216) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:27:10.182376 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7498e8b6-2f8d-4f0e-90dd-8ae10bce1ed8 None None] Sync routers for ids ['775c558e-eb61-4b1c-80f7-d59df2812bdc'] in dv-cinder-816187-2-iscsi {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:27:10.192183 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7498e8b6-2f8d-4f0e-90dd-8ae10bce1ed8 None None] Routers {'775c558e-eb61-4b1c-80f7-d59df2812bdc'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:27:10.192778 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-7498e8b6-2f8d-4f0e-90dd-8ae10bce1ed8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:26:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['775c558e-eb61-4b1c-80f7-d59df2812bdc'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:27:10.286209 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a14bfcf5-115c-421e-bd8e-4724518ada23 admin admin] Publish callbacks [] for router, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:10.385914 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a14bfcf5-115c-421e-bd8e-4724518ada23 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:10.420580 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-7498e8b6-2f8d-4f0e-90dd-8ae10bce1ed8 None None] Set router 775c558e-eb61-4b1c-80f7-d59df2812bdc gateway port host: dv-cinder-816187-2-iscsi {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:27:10.442325 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-a14bfcf5-115c-421e-bd8e-4724518ada23 admin admin] Deleting port 2e4e6d54-cd26-44b6-b7d7-25a59483eff0 {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:27:10.442575 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a14bfcf5-115c-421e-bd8e-4724518ada23 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:10.520420 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [None req-a14bfcf5-115c-421e-bd8e-4724518ada23 admin admin] For port 2e4e6d54-cd26-44b6-b7d7-25a59483eff0, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=2e4e6d54-cd26-44b6-b7d7-25a59483eff0,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:27:10.521112 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a14bfcf5-115c-421e-bd8e-4724518ada23 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:10.533613 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-a14bfcf5-115c-421e-bd8e-4724518ada23 admin admin] Calling delete_port for 2e4e6d54-cd26-44b6-b7d7-25a59483eff0 owned by network:router_gateway {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:27:10.592099 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-7498e8b6-2f8d-4f0e-90dd-8ae10bce1ed8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'name': 'tempest-TestShelveInstance-1067069244-router', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52'}], 'enable_snat': True}, 'gw_port_id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:21:45Z', 'updated_at': '2021-11-08T16:27:09Z', 'revision_number': 5, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'gw_port': {'id': '2e4e6d54-cd26-44b6-b7d7-25a59483eff0', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:5b:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 566, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:46Z', 'updated_at': '2021-11-08T16:21:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:27:10.621764 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7498e8b6-2f8d-4f0e-90dd-8ae10bce1ed8 None None] Checking router: 775c558e-eb61-4b1c-80f7-d59df2812bdc for host: dv-cinder-816187-2-iscsi {{(pid=101246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:27:10.642233 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7498e8b6-2f8d-4f0e-90dd-8ae10bce1ed8 None None] Routers {'775c558e-eb61-4b1c-80f7-d59df2812bdc'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:27:10.642843 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-7498e8b6-2f8d-4f0e-90dd-8ae10bce1ed8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:26:41Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['775c558e-eb61-4b1c-80f7-d59df2812bdc'], 'active': True} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:27:10.645825 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-c101ffdd-4830-41b5-93ac-6ce3bce423c4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:10.696002 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a14bfcf5-115c-421e-bd8e-4724518ada23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:10.718593 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a14bfcf5-115c-421e-bd8e-4724518ada23 admin admin] Pushing event deleted for resources: {'Port': ['ID=2e4e6d54-cd26-44b6-b7d7-25a59483eff0,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:27:10.725045 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_dvr_db [None req-7498e8b6-2f8d-4f0e-90dd-8ae10bce1ed8 None None] Set router 775c558e-eb61-4b1c-80f7-d59df2812bdc gateway port host: None {{(pid=101246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:27:10.779931 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.db.l3_hamode_db [None req-7498e8b6-2f8d-4f0e-90dd-8ae10bce1ed8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'name': 'tempest-TestShelveInstance-1067069244-router', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:21:45Z', 'updated_at': '2021-11-08T16:27:10Z', 'revision_number': 6, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'gw_port_host': None}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:27:10.784314 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a14bfcf5-115c-421e-bd8e-4724518ada23 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-2032325'] for router_gateway, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:10.806424 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7498e8b6-2f8d-4f0e-90dd-8ae10bce1ed8 None None] The sync data for ids ['775c558e-eb61-4b1c-80f7-d59df2812bdc'] in dv-cinder-816187-2-iscsi is: [{'id': '775c558e-eb61-4b1c-80f7-d59df2812bdc', 'name': 'tempest-TestShelveInstance-1067069244-router', 'tenant_id': '71b067e1fbac491a8e16a4ba91049db9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:21:45Z', 'updated_at': '2021-11-08T16:27:10Z', 'revision_number': 6, 'project_id': '71b067e1fbac491a8e16a4ba91049db9', 'gw_port_host': None}] {{(pid=101246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:27:10.823252 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device e8c812be-3317-46f0-9044-f415824262be no longer exists at agent hyperv_hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:27:10.846543 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] No Port match for: e8c812be-3317-46f0-9044-f415824262be {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:27:10.846886 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Device e8c812be-3317-46f0-9044-f415824262be not bound to the agent host hv-cinder-81618 {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:27:10.873796 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a14bfcf5-115c-421e-bd8e-4724518ada23 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-2034023', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-12866'] for router, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:10.875905 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a14bfcf5-115c-421e-bd8e-4724518ada23 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:10.917864 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a14bfcf5-115c-421e-bd8e-4724518ada23 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-2034044'] for router, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:10.918419 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a14bfcf5-115c-421e-bd8e-4724518ada23 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 775c558e-eb61-4b1c-80f7-d59df2812bdc {{(pid=101244) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 08 16:27:10.923638 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-a14bfcf5-115c-421e-bd8e-4724518ada23 admin admin] Publish callbacks [] for router, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:10.925464 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-a14bfcf5-115c-421e-bd8e-4724518ada23 admin admin] 10.222.0.37 "DELETE /v2.0/routers/775c558e-eb61-4b1c-80f7-d59df2812bdc HTTP/1.1" status: 204 len: 168 time: 0.7441061 Nov 08 16:27:10.928024 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 44218) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:27:10.971030 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_v2 [None req-758cfdd3-e11a-4105-a616-d0974c1da953 admin admin] Deleting subnet 67fc8ce5-82b1-4d6d-bf54-e59b246e08c9 {{(pid=101245) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 16:27:10.974498 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-758cfdd3-e11a-4105-a616-d0974c1da953 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:11.011232 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-758cfdd3-e11a-4105-a616-d0974c1da953 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5113603'] for subnet, precommit_delete_associations {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:11.082465 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-758cfdd3-e11a-4105-a616-d0974c1da953 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-872226'] for subnet, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:11.134262 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-758cfdd3-e11a-4105-a616-d0974c1da953 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-872235', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7464090', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6098572'] for subnet, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:11.158840 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-758cfdd3-e11a-4105-a616-d0974c1da953 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=67fc8ce5-82b1-4d6d-bf54-e59b246e08c9,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:27:11.163049 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-758cfdd3-e11a-4105-a616-d0974c1da953 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:11.168663 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-758cfdd3-e11a-4105-a616-d0974c1da953 admin admin] 10.222.0.37 "DELETE /v2.0/subnets/67fc8ce5-82b1-4d6d-bf54-e59b246e08c9 HTTP/1.1" status: 204 len: 168 time: 0.2372615 Nov 08 16:27:11.169443 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 44220) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:27:11.171046 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d6fad13e-f2a7-462a-9a4d-f48bd84cb44b None None] Network f9b0f22e-a782-44ad-bfe0-8de1f795305e requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:27:11.242700 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5f660a4f-3182-4b83-bbd9-4c462b7f81b6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1007047'] for network, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:11.301509 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-5f660a4f-3182-4b83-bbd9-4c462b7f81b6 admin admin] Deleting port 4dc08b68-9f5b-47a8-a7bd-ea939e5ade06 {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:27:11.301871 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5f660a4f-3182-4b83-bbd9-4c462b7f81b6 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:11.362387 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [None req-5f660a4f-3182-4b83-bbd9-4c462b7f81b6 admin admin] For port 4dc08b68-9f5b-47a8-a7bd-ea939e5ade06, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=4dc08b68-9f5b-47a8-a7bd-ea939e5ade06,segment=NetworkSegment(d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c),segment_id=d3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:27:11.362748 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5f660a4f-3182-4b83-bbd9-4c462b7f81b6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:11.375404 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-5f660a4f-3182-4b83-bbd9-4c462b7f81b6 admin admin] Calling delete_port for 4dc08b68-9f5b-47a8-a7bd-ea939e5ade06 owned by network:dhcp {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:27:11.452921 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5f660a4f-3182-4b83-bbd9-4c462b7f81b6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:11.479986 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f660a4f-3182-4b83-bbd9-4c462b7f81b6 admin admin] Pushing event deleted for resources: {'Port': ['ID=4dc08b68-9f5b-47a8-a7bd-ea939e5ade06,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:27:11.481738 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f660a4f-3182-4b83-bbd9-4c462b7f81b6 admin admin] No DVR routers for this DVR port 4dc08b68-9f5b-47a8-a7bd-ea939e5ade06 on host dv-cinder-816187-2-iscsi {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:27:11.551047 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5f660a4f-3182-4b83-bbd9-4c462b7f81b6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-869719', 'neutron.services.segments.db._delete_segments_for_network-8792877333297'] for network, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:11.574290 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-5f660a4f-3182-4b83-bbd9-4c462b7f81b6 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f9b0f22e-a782-44ad-bfe0-8de1f795305e']}} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:27:11.584799 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-5f660a4f-3182-4b83-bbd9-4c462b7f81b6 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c') {'for_net_delete': True} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:27:11.585080 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-5f660a4f-3182-4b83-bbd9-4c462b7f81b6 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd3ac8d7c-14e7-4c5a-b7ef-ba8715daad5c') {} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:27:11.587345 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:11.595562 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e3e462f-d503-455a-9f34-848e388dce00 None None] DHCP port deletion for f9b0f22e-a782-44ad-bfe0-8de1f795305e request from dv-cinder-816187-2-iscsi {{(pid=101246) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 08 16:27:11.597533 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5f660a4f-3182-4b83-bbd9-4c462b7f81b6 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792877333818', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8047118'] for segment, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:11.615598 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5f660a4f-3182-4b83-bbd9-4c462b7f81b6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:11.622170 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5f660a4f-3182-4b83-bbd9-4c462b7f81b6 admin admin] Releasing vlan 190 on physical network physnet1 to pool {{(pid=101244) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 16:27:11.622820 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5f660a4f-3182-4b83-bbd9-4c462b7f81b6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4227628'] for segment, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: Traceback (most recent call last): Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: timer() Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: cb(*args, **kw) Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: return func(*args, **kwargs) Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: self._notify() Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: self.callback(batched_events) Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: event.method(event) Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: return f(self, *a, **k) Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: return self._get(url).json() Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: return self.request(url, 'GET', **kwargs) Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 16:27:11.624601 dv-cinder-816187-2-iscsi neutron-server[101244]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 16:27:11.676316 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5f660a4f-3182-4b83-bbd9-4c462b7f81b6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-868772', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-2032313'] for network, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:11.681566 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-5f660a4f-3182-4b83-bbd9-4c462b7f81b6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:11.684703 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-5f660a4f-3182-4b83-bbd9-4c462b7f81b6 admin admin] 10.222.0.37 "DELETE /v2.0/networks/f9b0f22e-a782-44ad-bfe0-8de1f795305e HTTP/1.1" status: 204 len: 168 time: 0.5141962 Nov 08 16:27:11.687774 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 44222) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:27:11.695307 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f660a4f-3182-4b83-bbd9-4c462b7f81b6 admin admin] Pushing event deleted for resources: {'Network': ['ID=f9b0f22e-a782-44ad-bfe0-8de1f795305e,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:27:11.975212 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 4dc08b68-9f5b-47a8-a7bd-ea939e5ade06 no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:27:11.993945 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: 4dc08b68-9f5b-47a8-a7bd-ea939e5ade06 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:27:11.994286 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 4dc08b68-9f5b-47a8-a7bd-ea939e5ade06 not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:27:11.994697 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 2e4e6d54-cd26-44b6-b7d7-25a59483eff0 no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:27:12.014049 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: 2e4e6d54-cd26-44b6-b7d7-25a59483eff0 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:27:12.014397 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 2e4e6d54-cd26-44b6-b7d7-25a59483eff0 not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:27:12.014799 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 3a14a839-f3ee-4231-a9b5-00067b56ef01 no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:27:12.033044 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-71d1e40e-e0e3-406c-9aae-637fbb08b37b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-2033295'] for router_interface, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:12.033818 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: 3a14a839-f3ee-4231-a9b5-00067b56ef01 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:27:12.034185 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 3a14a839-f3ee-4231-a9b5-00067b56ef01 not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:27:12.269062 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-71d1e40e-e0e3-406c-9aae-637fbb08b37b admin admin] Deleting port f2f60e0f-a89e-47cf-9555-ff4b78af6adb {{(pid=101245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:27:12.269393 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-71d1e40e-e0e3-406c-9aae-637fbb08b37b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:12.342337 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [None req-71d1e40e-e0e3-406c-9aae-637fbb08b37b admin admin] For port f2f60e0f-a89e-47cf-9555-ff4b78af6adb, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=f2f60e0f-a89e-47cf-9555-ff4b78af6adb,segment=NetworkSegment(10cf7f40-17b2-437d-b05e-09a41ffbf808),segment_id=10cf7f40-17b2-437d-b05e-09a41ffbf808)] {{(pid=101245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:27:12.342635 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-71d1e40e-e0e3-406c-9aae-637fbb08b37b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:12.354529 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-71d1e40e-e0e3-406c-9aae-637fbb08b37b admin admin] Calling delete_port for f2f60e0f-a89e-47cf-9555-ff4b78af6adb owned by network:router_interface {{(pid=101245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:27:12.523109 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-71d1e40e-e0e3-406c-9aae-637fbb08b37b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:12.552794 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71d1e40e-e0e3-406c-9aae-637fbb08b37b admin admin] Pushing event deleted for resources: {'Port': ['ID=f2f60e0f-a89e-47cf-9555-ff4b78af6adb,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:27:12.954256 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-71d1e40e-e0e3-406c-9aae-637fbb08b37b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1599532', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-2034495'] for router_interface, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:13.162516 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-71d1e40e-e0e3-406c-9aae-637fbb08b37b admin admin] Router 2b283ba5-8550-4152-a1be-c8c7a628d94b has already been hosted by L3 agent 62506ad7-138f-4f03-8e19-bc6187d0744f {{(pid=101245) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 16:27:13.263523 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-71d1e40e-e0e3-406c-9aae-637fbb08b37b admin admin] Notify agent at l3_agent.dv-cinder-816187-2-iscsi the message routers_updated {{(pid=101245) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 16:27:13.271702 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-71d1e40e-e0e3-406c-9aae-637fbb08b37b admin admin] 10.222.0.37 "PUT /v2.0/routers/2b283ba5-8550-4152-a1be-c8c7a628d94b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5797849 Nov 08 16:27:13.271857 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 44224) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:27:13.272664 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dda235ad-7903-4ad2-9403-77282faf603b None None] Sync routers for ids ['2b283ba5-8550-4152-a1be-c8c7a628d94b'] in dv-cinder-816187-2-iscsi {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 16:27:13.281955 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dda235ad-7903-4ad2-9403-77282faf603b None None] Routers {'2b283ba5-8550-4152-a1be-c8c7a628d94b'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:27:13.282549 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-dda235ad-7903-4ad2-9403-77282faf603b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:27:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['2b283ba5-8550-4152-a1be-c8c7a628d94b'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:27:13.330184 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:13.378178 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5eadce78-393c-4637-aee8-85a2d14c2fbe admin admin] Publish callbacks [] for router, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:13.403118 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-dda235ad-7903-4ad2-9403-77282faf603b None None] Set router 2b283ba5-8550-4152-a1be-c8c7a628d94b gateway port host: dv-cinder-816187-2-iscsi {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:27:13.480336 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5eadce78-393c-4637-aee8-85a2d14c2fbe admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:13.530845 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-5eadce78-393c-4637-aee8-85a2d14c2fbe admin admin] Deleting port 2793bc35-fa22-41fb-bd57-390a71fb9687 {{(pid=101245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:27:13.531076 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5eadce78-393c-4637-aee8-85a2d14c2fbe admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:13.585934 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-dda235ad-7903-4ad2-9403-77282faf603b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b283ba5-8550-4152-a1be-c8c7a628d94b', 'name': 'tempest-TestShelveInstance-632815821-router', 'tenant_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'external_fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.254'}], 'enable_snat': True}, 'gw_port_id': '2793bc35-fa22-41fb-bd57-390a71fb9687', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:21:51Z', 'updated_at': '2021-11-08T16:27:12Z', 'revision_number': 5, 'project_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'gw_port': {'id': '2793bc35-fa22-41fb-bd57-390a71fb9687', 'name': '', 'network_id': '68f46265-b42a-49a0-8d57-f9362045cd9b', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:cf:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b283ba5-8550-4152-a1be-c8c7a628d94b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 578, 'fixed_ips': [{'subnet_id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'ip_address': '172.27.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816187-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T16:21:52Z', 'updated_at': '2021-11-08T16:21:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4728e4be-5a19-43c0-89cf-ced2a190645d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816187-2-iscsi'}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:27:13.607422 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.db [None req-5eadce78-393c-4637-aee8-85a2d14c2fbe admin admin] For port 2793bc35-fa22-41fb-bd57-390a71fb9687, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=2793bc35-fa22-41fb-bd57-390a71fb9687,segment=NetworkSegment(5654fd20-eb76-4a3d-8fc2-e37f9aa812c4),segment_id=5654fd20-eb76-4a3d-8fc2-e37f9aa812c4)] {{(pid=101245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:27:13.607779 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5eadce78-393c-4637-aee8-85a2d14c2fbe admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:13.612361 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dda235ad-7903-4ad2-9403-77282faf603b None None] Checking router: 2b283ba5-8550-4152-a1be-c8c7a628d94b for host: dv-cinder-816187-2-iscsi {{(pid=101247) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 16:27:13.620107 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.plugins.ml2.plugin [None req-5eadce78-393c-4637-aee8-85a2d14c2fbe admin admin] Calling delete_port for 2793bc35-fa22-41fb-bd57-390a71fb9687 owned by network:router_gateway {{(pid=101245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:27:13.620466 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dda235ad-7903-4ad2-9403-77282faf603b None None] Routers {'2b283ba5-8550-4152-a1be-c8c7a628d94b'} bound to L3 agent in host dv-cinder-816187-2-iscsi {{(pid=101247) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 16:27:13.621066 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-dda235ad-7903-4ad2-9403-77282faf603b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816187-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-08T16:03:11Z,description=,heartbeat_timestamp=2021-11-08T16:27:11Z,host='dv-cinder-816187-2-iscsi',id=62506ad7-138f-4f03-8e19-bc6187d0744f,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T16:03:11Z,topic='l3_agent')) {'router_ids': ['2b283ba5-8550-4152-a1be-c8c7a628d94b'], 'active': True} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:27:13.703403 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_dvr_db [None req-dda235ad-7903-4ad2-9403-77282faf603b None None] Set router 2b283ba5-8550-4152-a1be-c8c7a628d94b gateway port host: None {{(pid=101247) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 16:27:13.756671 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.l3_hamode_db [None req-dda235ad-7903-4ad2-9403-77282faf603b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b283ba5-8550-4152-a1be-c8c7a628d94b', 'name': 'tempest-TestShelveInstance-632815821-router', 'tenant_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:21:51Z', 'updated_at': '2021-11-08T16:27:13Z', 'revision_number': 6, 'project_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'gw_port_host': None}], 'dv-cinder-816187-2-iscsi', False) {} {{(pid=101247) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:27:13.778212 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5eadce78-393c-4637-aee8-85a2d14c2fbe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7464015'] for port, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:13.783280 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dda235ad-7903-4ad2-9403-77282faf603b None None] The sync data for ids ['2b283ba5-8550-4152-a1be-c8c7a628d94b'] in dv-cinder-816187-2-iscsi is: [{'id': '2b283ba5-8550-4152-a1be-c8c7a628d94b', 'name': 'tempest-TestShelveInstance-632815821-router', 'tenant_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T16:21:51Z', 'updated_at': '2021-11-08T16:27:13Z', 'revision_number': 6, 'project_id': '9bc7b00c5fe3471e84c0e2acaaa7d008', 'gw_port_host': None}] {{(pid=101247) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 16:27:13.807524 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5eadce78-393c-4637-aee8-85a2d14c2fbe admin admin] Pushing event deleted for resources: {'Port': ['ID=2793bc35-fa22-41fb-bd57-390a71fb9687,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:27:13.865161 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5eadce78-393c-4637-aee8-85a2d14c2fbe admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-2032325'] for router_gateway, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:13.951339 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5eadce78-393c-4637-aee8-85a2d14c2fbe admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-2034023', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-12866'] for router, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:13.953377 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5eadce78-393c-4637-aee8-85a2d14c2fbe admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:13.975409 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:13.999271 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5eadce78-393c-4637-aee8-85a2d14c2fbe admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-2034044'] for router, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:13.999932 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5eadce78-393c-4637-aee8-85a2d14c2fbe admin admin] Fanout notify agent at l3_agent the message router_deleted on router 2b283ba5-8550-4152-a1be-c8c7a628d94b {{(pid=101245) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 08 16:27:14.005508 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-5eadce78-393c-4637-aee8-85a2d14c2fbe admin admin] Publish callbacks [] for router, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:14.006678 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-5eadce78-393c-4637-aee8-85a2d14c2fbe admin admin] 10.222.0.37 "DELETE /v2.0/routers/2b283ba5-8550-4152-a1be-c8c7a628d94b HTTP/1.1" status: 204 len: 168 time: 0.7339048 Nov 08 16:27:14.009159 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.wsgi [-] (101245) accepted ('10.222.0.37', 44226) {{(pid=101245) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:27:14.055048 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.db.db_base_plugin_v2 [None req-4b2f2bce-0eaa-47dd-bb93-5d553b678b6d admin admin] Deleting subnet 4b234dcd-085a-48b7-8b98-50c1a76e059b {{(pid=101245) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 16:27:14.057949 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4b2f2bce-0eaa-47dd-bb93-5d553b678b6d admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:14.092095 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4b2f2bce-0eaa-47dd-bb93-5d553b678b6d admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5113603'] for subnet, precommit_delete_associations {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:14.178099 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4b2f2bce-0eaa-47dd-bb93-5d553b678b6d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-872226'] for subnet, precommit_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:14.239145 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4b2f2bce-0eaa-47dd-bb93-5d553b678b6d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-872235', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-74240', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7464090', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6098572'] for subnet, after_delete {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:14.270183 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron_lib.callbacks.manager [None req-4b2f2bce-0eaa-47dd-bb93-5d553b678b6d admin admin] Publish callbacks [] for subnet, before_response {{(pid=101245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:14.275478 dv-cinder-816187-2-iscsi neutron-server[101245]: INFO neutron.wsgi [None req-4b2f2bce-0eaa-47dd-bb93-5d553b678b6d admin admin] 10.222.0.37 "DELETE /v2.0/subnets/4b234dcd-085a-48b7-8b98-50c1a76e059b HTTP/1.1" status: 204 len: 168 time: 0.2632158 Nov 08 16:27:14.275478 dv-cinder-816187-2-iscsi neutron-server[101245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b2f2bce-0eaa-47dd-bb93-5d553b678b6d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4b234dcd-085a-48b7-8b98-50c1a76e059b,revision_number=None']} {{(pid=101245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:27:14.275718 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d8523d1f-3aa1-4f78-a085-676ed96b1115 None None] Network 5a75ccbd-4f9f-4f1a-b9e5-4921f028e916 requested from dv-cinder-816187-2-iscsi {{(pid=101246) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 16:27:14.276349 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 44228) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:27:14.345059 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-af56dee0-69ed-4e35-a804-96e21f66280d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1007047'] for network, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:14.397033 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-af56dee0-69ed-4e35-a804-96e21f66280d admin admin] Deleting port 952c8a89-737f-42cc-810f-a2185847289b {{(pid=101244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 16:27:14.397360 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-af56dee0-69ed-4e35-a804-96e21f66280d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792877250744'] for port, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:14.458522 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.db [None req-af56dee0-69ed-4e35-a804-96e21f66280d admin admin] For port 952c8a89-737f-42cc-810f-a2185847289b, host dv-cinder-816187-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816187-2-iscsi',level=0,port_id=952c8a89-737f-42cc-810f-a2185847289b,segment=NetworkSegment(10cf7f40-17b2-437d-b05e-09a41ffbf808),segment_id=10cf7f40-17b2-437d-b05e-09a41ffbf808)] {{(pid=101244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 16:27:14.458871 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-af56dee0-69ed-4e35-a804-96e21f66280d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-2060073'] for port, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:14.471064 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.plugin [None req-af56dee0-69ed-4e35-a804-96e21f66280d admin admin] Calling delete_port for 952c8a89-737f-42cc-810f-a2185847289b owned by network:dhcp {{(pid=101244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 16:27:14.551953 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-af56dee0-69ed-4e35-a804-96e21f66280d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-582554', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-187536', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792877257602', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792876777364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4227615'] for port, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:14.573910 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-08b74788-9aae-4d8e-82b2-139929fc70a2 None None] DHCP port deletion for 5a75ccbd-4f9f-4f1a-b9e5-4921f028e916 request from dv-cinder-816187-2-iscsi {{(pid=101246) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 08 16:27:14.575884 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device f2f60e0f-a89e-47cf-9555-ff4b78af6adb no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:27:14.580287 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af56dee0-69ed-4e35-a804-96e21f66280d admin admin] Pushing event deleted for resources: {'Port': ['ID=952c8a89-737f-42cc-810f-a2185847289b,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:27:14.585025 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af56dee0-69ed-4e35-a804-96e21f66280d admin admin] No DVR routers for this DVR port 952c8a89-737f-42cc-810f-a2185847289b on host dv-cinder-816187-2-iscsi {{(pid=101244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 16:27:14.605839 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: f2f60e0f-a89e-47cf-9555-ff4b78af6adb {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:27:14.606156 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device f2f60e0f-a89e-47cf-9555-ff4b78af6adb not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:27:14.661670 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-af56dee0-69ed-4e35-a804-96e21f66280d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-869719', 'neutron.services.segments.db._delete_segments_for_network-8792877333297'] for network, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:14.682363 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-af56dee0-69ed-4e35-a804-96e21f66280d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5a75ccbd-4f9f-4f1a-b9e5-4921f028e916']}} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:27:14.691477 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-af56dee0-69ed-4e35-a804-96e21f66280d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '10cf7f40-17b2-437d-b05e-09a41ffbf808') {'for_net_delete': True} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:27:14.691772 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.services.segments.db [None req-af56dee0-69ed-4e35-a804-96e21f66280d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '10cf7f40-17b2-437d-b05e-09a41ffbf808') {} {{(pid=101244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 16:27:14.700842 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-af56dee0-69ed-4e35-a804-96e21f66280d admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792877333818', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8047118'] for segment, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:14.714126 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-af56dee0-69ed-4e35-a804-96e21f66280d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955'] for segment, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:14.720152 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-af56dee0-69ed-4e35-a804-96e21f66280d admin admin] Releasing vlan 168 on physical network physnet1 to pool {{(pid=101244) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 16:27:14.720537 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-af56dee0-69ed-4e35-a804-96e21f66280d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-873955', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4227628'] for segment, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: Traceback (most recent call last): Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: timer() Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: cb(*args, **kw) Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: return func(*args, **kwargs) Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: self._notify() Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: self.callback(batched_events) Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: event.method(event) Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: return f(self, *a, **k) Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: return self._get(url).json() Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: return self.request(url, 'GET', **kwargs) Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 16:27:14.722812 dv-cinder-816187-2-iscsi neutron-server[101244]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 16:27:14.778341 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-af56dee0-69ed-4e35-a804-96e21f66280d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-868772', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2033975', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1599703', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-2032313'] for network, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:14.784277 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-af56dee0-69ed-4e35-a804-96e21f66280d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1599681'] for network, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:14.787531 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-af56dee0-69ed-4e35-a804-96e21f66280d admin admin] 10.222.0.37 "DELETE /v2.0/networks/5a75ccbd-4f9f-4f1a-b9e5-4921f028e916 HTTP/1.1" status: 204 len: 168 time: 0.5101976 Nov 08 16:27:14.798759 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af56dee0-69ed-4e35-a804-96e21f66280d admin admin] Pushing event deleted for resources: {'Network': ['ID=5a75ccbd-4f9f-4f1a-b9e5-4921f028e916,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:27:14.901244 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 44232) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:27:14.938717 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-686ec13d-3ac5-4c5b-8519-e7c503234d07 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=71b067e1fbac491a8e16a4ba91049db9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0362942 Nov 08 16:27:14.941483 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 44234) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:27:14.989683 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-81767757-576b-4ab0-a768-433a29cc6af2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:15.010234 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-81767757-576b-4ab0-a768-433a29cc6af2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:15.054396 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-81767757-576b-4ab0-a768-433a29cc6af2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:15.057148 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-81767757-576b-4ab0-a768-433a29cc6af2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:15.058357 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-81767757-576b-4ab0-a768-433a29cc6af2 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/90c49503-72c6-42ed-a78a-abf10c8bd51f HTTP/1.1" status: 204 len: 168 time: 0.1159892 Nov 08 16:27:15.066407 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81767757-576b-4ab0-a768-433a29cc6af2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=90c49503-72c6-42ed-a78a-abf10c8bd51f,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:27:15.363110 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 44240) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:27:15.402960 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-99225585-d7dc-4155-b204-2aaed47c0195 admin admin] 10.222.0.37 "GET /v2.0/security-groups?tenant_id=9bc7b00c5fe3471e84c0e2acaaa7d008&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0385118 Nov 08 16:27:15.405187 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.wsgi [-] (101244) accepted ('10.222.0.37', 44242) {{(pid=101244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 16:27:15.450798 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-88dd2534-e7d6-40d6-b321-d37755f63a25 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:15.472418 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-88dd2534-e7d6-40d6-b321-d37755f63a25 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:15.517012 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-88dd2534-e7d6-40d6-b321-d37755f63a25 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2081761'] for security_group, after_delete {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:15.520146 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron_lib.callbacks.manager [None req-88dd2534-e7d6-40d6-b321-d37755f63a25 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:15.523523 dv-cinder-816187-2-iscsi neutron-server[101244]: INFO neutron.wsgi [None req-88dd2534-e7d6-40d6-b321-d37755f63a25 admin admin] 10.222.0.37 "DELETE /v2.0/security-groups/396b269c-b60c-499e-93f5-39ca50f7e9e2 HTTP/1.1" status: 204 len: 168 time: 0.1151893 Nov 08 16:27:15.528721 dv-cinder-816187-2-iscsi neutron-server[101244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88dd2534-e7d6-40d6-b321-d37755f63a25 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=396b269c-b60c-499e-93f5-39ca50f7e9e2,revision_number=None']} {{(pid=101244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 16:27:15.986560 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 2793bc35-fa22-41fb-bd57-390a71fb9687 no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:27:16.008689 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: 2793bc35-fa22-41fb-bd57-390a71fb9687 {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:27:16.009026 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 2793bc35-fa22-41fb-bd57-390a71fb9687 not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:27:16.009428 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 952c8a89-737f-42cc-810f-a2185847289b no longer exists at agent ovs-agent-dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 16:27:16.027867 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.plugin [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] No Port match for: 952c8a89-737f-42cc-810f-a2185847289b {{(pid=101246) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 16:27:16.028201 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron.plugins.ml2.rpc [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Device 952c8a89-737f-42cc-810f-a2185847289b not bound to the agent host dv-cinder-816187-2-iscsi {{(pid=101246) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 16:27:19.788326 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:20.590298 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:27:38.152149 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-f2880411-60f1-4aca-a074-d8e1ce87e805 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:40.616168 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-32b91dfb-9c1c-4b34-b3da-1185e629b45e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:41.588235 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:43.324598 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:43.977208 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:49.784023 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:27:57.589801 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:28:08.153190 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-edebfa82-f253-49e1-97b7-dadd2d1bcf91 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:28:10.615355 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6ed5d902-5464-40e6-a40c-801cf0130df2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:28:11.591710 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:28:13.325374 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:28:13.978807 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:28:19.805769 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:28:34.589529 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:28:38.154840 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-a63d7fb6-c364-4e20-a51c-b71b9397a37f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:28:40.616839 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-d8059a67-03cb-47ba-a922-3a893b3543b8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:28:41.596238 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:28:43.329977 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:28:43.979715 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:28:49.827815 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:29:08.155478 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-1a544e69-7325-4f50-b253-e7181bf8b160 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:29:10.616735 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-faebc6a3-293f-4285-ad20-9e1525203f48 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:29:11.594657 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:29:11.601314 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:29:13.361767 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:29:13.980625 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:29:19.827157 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:29:38.156987 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-62a14942-0e3f-45d2-9198-9a43876d3006 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:29:40.618242 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-255b28bb-02df-4c4b-a113-91513d29f265 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:29:41.597885 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:29:43.333090 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:29:43.982806 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:29:48.593754 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:29:49.841550 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:30:08.158699 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-abe40300-9649-41a5-9911-e72d628a0126 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:30:10.618627 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-eda879bb-6c7a-4c7a-a35e-e4c92283bea3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:30:11.602215 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:30:13.334404 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:30:13.983632 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:30:19.838197 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:30:25.592373 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:30:38.160413 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-eb706984-bea5-48bc-9302-2d0bf5600cad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:30:40.620000 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-41cda672-f674-4d33-8989-afa3725f424a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:30:41.606506 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:30:43.337901 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:30:43.984910 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:30:49.849061 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:31:02.591774 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:31:08.161365 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-44093388-d59e-4d73-8d2b-7171c7ec5c3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:31:10.620811 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-068f6d53-cdef-460f-9529-831d9bc834ca None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:31:11.609221 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:31:13.364559 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:31:13.988765 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:31:19.853473 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:31:38.161727 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-f9a8235d-8f9b-442e-bbea-59c6621686d3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:31:39.590763 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:31:40.623375 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-33f3061e-4ffd-487a-9fc3-2cac253b6dd1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:31:41.610501 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:31:43.341024 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:31:43.989883 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:31:49.870726 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:32:08.162398 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-e7310e4e-8302-4f5e-9e30-caf8eefb9968 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:32:10.627355 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cecfb578-5e88-4b0c-a0db-a30547608750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:32:11.614236 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:32:13.343198 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:32:13.990155 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:32:16.589185 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 16:32:19.882632 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:32:38.164167 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6ed0d58e-0b91-462c-a5bf-03def3a9cce0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:32:40.627384 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-0296b467-25e9-49fb-97a2-74503d8fcbc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:32:41.615776 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-13ee5915-eb00-4718-9d3c-bc7efec936c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:32:43.345658 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-ea8bfed6-d819-4693-97ca-a60f0dc69b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:32:43.990293 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-6de23c41-a8dd-4471-ac78-73e1c9247a96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:32:49.897620 dv-cinder-816187-2-iscsi neutron-server[101246]: DEBUG neutron_lib.callbacks.manager [None req-cf47d61f-4235-4d5b-9c87-fc104f374d78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792877333279', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-883553'] for agent, after_update {{(pid=101246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 16:32:53.589679 dv-cinder-816187-2-iscsi neutron-server[101247]: DEBUG neutron.db.agents_db [None req-ada2a1ff-a334-4eec-898f-ae9f704e8006 None None] Agent healthcheck: found 6 active agents {{(pid=101247) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}}